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PREFACE 

The  evaluation  and  planning  model  presented  in  this  document  has  been 
prepared  as  an  aid  to  State  and  local  EPSDT  project  administrators.  It 
has  been  developed  on  the  assumption  that  States  and  local  projects 
presently  collect  data  used  for  management  purposes.  Rather  than  develop 
an  entirely  new  data  system,  the  model  provides  a  general  approach  to 
analyzing  available  data  for  use  in  evaluation  and  planning. 

This  model  is  the  result  of  several  years  of  effort  detailing  State  and 
local  Early  and  Periodic  Screening,  Diagnostic  and  Treatment  programs. 
These  investigations  specified  the  degree  to  which  EPSDT  was  implemented 
locally  with  particular  attention  directed  to  uncovering  problems  which 
militated  against  program  success.  This  information—that  is,  understand- 
ing of  the  efforts  being  undertaken  and  identification  of  the  problems- 
is  the  basis  for  the  development  of  a  general  model  for  EPSDT  planning  and 
evaluation. 
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In  the  preliminary  studies*  the  widespread  variation  in  program  implementa- 
tion across  the  States  was  evidenced.  Of  particular  importance  was  the 
degree  to  which  States  and  local  projects  had  developed  different  support 
systems  to  meet  their  needs,  particularly  systems  which  provided  data  describ- 
ing program  operations.  That  these  differences  in  data  systems  were  obtained 
was  to  be  anticipated.  They  reflect  the  wide  variation  of  program  efforts 
States  have  undertaken  to  implement  the  legislative  mandate  of  EPSDT.  To 
accommodate  State  and  local  efforts,  the  model  presented  here  utilizes  a 
"data  classification"  concept  broad  enough  to  cover  the  wide  variation  in 
State  EPSDT  data  systems. 

The  alternative  approach  of  designing  a  highly  specific  evaluation  system, 
mandated  by  the  Federal  government,  was  not  deemed  appropriate.  Such  an 
approach  would  require  States  to  meet  exacting  prescriptions  for  data 
elements  and  to  redevelop  their  data  systems,  culminating  in  a  common 
reporting  system. 

At  first  consideration  such  a  strategy  may  appear  feasible.  However,  this 
approach  would  conflict  with  the  freedom  with  which  States  are  allowed  to 


*  A  series  of  preliminary  reports  prepared  under  SRS  Contract  74-63  may 
be  obtained  by  writing  to  the  Office  of  Planning,  Evaluation  and  Research, 
Social  and  Rehabilitation  Service,  Department  of  Health,  Education,  and 
Welfare,  Washington,  D.C.  20201. 
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develop  their  own  programs.  Attempting  to  mandate  a  highly  structured 
planning  and  evaluation  system  without  also  requiring  that  States  obtain 
commonality  of  health  service  delivery  methods*  would  yield  a  system 
which  on  the  surface  would  appear  to  provide  common  data  sets  but  which 
in  reality  would  produce  misleading  information.  Such  a  system,  for 
example,  might  provide  cost  data  for  screening  which,  when  examined,  might 
lead  one  to  conclude  that  one  State  was  able  to  provide  screening  at  a 
lower  rate  than  another.  The  fact  that  one  State's  eligible  population  was 
highly  rural,  that  they  used  solo  providers  exclusively  for  screening  as 
opposed  to  health  clinics,  and  that  the  screening  packages  were  different 
would  not  be  reflected  in  the  common  reporting  data  elements.  Furthermore, 
to  attempt  to  define  a  weighting  system  whereby  each  of  the  service  elements 
would  be  reflected  is  not  only  a  monumental  task  but  far  beyond  present 
analytical  capabilities. 


In  addition,  even  if  a  detailed  data  system  were  mandated  upon  the  States, 
there  is  a  strong  possibility  that  existing  systems  which  meet  local  users 


• 


These  problems  are  compounded  by  the  fact  that  health  care  is  not  a 
precise  science.  Consequently,  not  only  does  each  State  have  the  ability 
to  structure  its  program  in  a  fashion  appropriate  to  its  capabilities, 
but  each  medical  provider  in  turn  has  his  own  idiosyncratic  method  of 
offering  service.  Specific  systems  applications  which  work  in  the 
production  of  steel  or  automobiles  have  not  proved  very  successful  when 
applied  in  an  intransigent  manner  to  imprecise  human  programs. 
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needs  would  continue  to  be  maintained.  The  error  and  burden  which  would 
result  from  maintaining  two  systems,  one  of  which  would  not  be  seen  in  the 
interests  of  the  local  user,  would  produce  results  having  questionable 
credibility.* 

After  much  consideration  of  the  problems  encountered  working  with  State 
EPSDT  programs,  the  State  and  local  planning  and  evaluation  system  presented 
here  was  developed  to  permit  flexibility  of  implementation  at  the  State 
and  local  levels.  Rather  than  mandating  an  exacting  comprehensive  revision 
of  existing  data  systems,  the  planning  and  evaluation  model  is  defined  by 
a  set  of  output  reports  which  reflect  critical  indicators  of  program  status. 
These  output  reports  can  be  prepared  using  minimal  data  sets  which 
generally  are  in  place  at  State  and  local  levels.  It  is  therefore  expected 
that  existing  State  and  local  data  systems  can  be  utilized  with  minimal 
change. 

The  present  model  rests  on  an  approach  commonly  called  data  classification, 
which  can  best  be  defined  by  example.  The  recommended  planning  and  evalua- 
tion reports  which  permit  one  to  observe  screening  service  status  require 
an  accumulation  of  data  describing  "screening  findings."  The  term  "screening 
findings"  reflects  a  generic  classification  with  the  level  of  detail  left 


*  The  history  of  common  reports  being  required  by  the  Federal  government 
is  fraught  with  such  failures. 
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to  the  discretion  of  each  particular  program  manager.  The  analyses 
which  permit  one  to  assess  the  effects  of  the  screening  efforts  may  be 
applied  irrespective  of  the  level  of  data  detail.  So,  for  example,  one 
State  which  reports  its  findings  in  terms  of  the  gross  screening  definitions 
mandated  by  the  legislation— i  .e. ,  dental,  hearing,  vision,  other—may 
examine  its  program  status  using  the  level  of  data  available.  Another 
State  whose  data  is  highly  detailed  (e.g.,  screening  findings  are  reported 
according  to  ICDA-8  codes)  can  also  apply  the  same  general  analyses.  The 
data  classification  approach  offers  the  opportunity  for  improving  planning 
and  evaluation  capabilities  without  demanding  the  massive  reorganization 
of  locally  developed  systems  at  a  prohibitive  cost. 

One  final  word  of  caution.  The  model  presented  in  this  document  is  not  a 
prescription  for  instant  program  management  success.  To  the  contrary, 
utilization  of  the  reports  making  up  the  planning  and  evaluation  model  may 
provide  the  project  manager  with  an  unanticipated  picture  of  the  present 
status  of  EPSDT.  What  is  critical,  then,  are  the  decisions  that  the 
program  manager  makes  in  order  to  reduce  the  problems  he  finds  through 
use  of  the  evaluation  and  planning  system. 

November,  1976 


CHAPTER  I:  RATIONALE  AND 
FUNCTIONS 


1.0  Introduction 


The  purpose  of  this  section  is  to  describe  briefly  the  development 
of  this  model  and  to  provide  a  functional  orientation  for  its  use. 

1,1   EVALUATION  AND  PLANNING: THE  PROCESS  OF  SOCIAL 
PROGRAM  CHANGE 

All  social  programs  can  be  defined  by  their  policy  objective, 
that  is,  "What  is  the  intent  of  the  program?"  Furthermore, 
the  structure  of  the  definition  should  serve  to  further  delineate 
specific  objectives  of.  each  functional  element  of  the  program. 
EPSDT,  for  example,  may  be  defined  as  a  program  of  comprehensive 
health  care  for  Medicaid  eligible  children  and  youth  offered  to 
improve  health  status  of  the  targeted  population.  The  legis- 
lation embodying  EPSDT  goes  further,  mandating  a  program  of 
service,  namely  the  delivery  of  early  and  periodic  screening 
to  eligible  children  followed  by  diagnosis  and  treatment  of 
positive  screening  findings. 

The  intent  of  the  legislation  has  then  been  delineated  into 
operational  functions  by  each  State  and  local  project  for 
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the  purpose  of  obtaining  the  original  policy  objectives. 

At  each  level,  decisions  and  assumptions  about  how  best  to 
achieve  the  basic  policy  must  be  made.  For  example,  although 
the  service  delivery  strategy  proposed  in  EPSDT  legislation 
presumably  improves  health  status,  EPSDT  resources  could  have 
been  applied  to  basic  environmental  and  public  health  strategies 
or  to  increase  income  transfer  payment  programs  which  also 
affect  health  status  in  a  positive  direction.  Similarly, 
specific  State  and  local  decisions  vis-a-vis  the  definition 
of  screening  packages,  the  use  of  types  of  providers,  reflect 
assumptions  of  client  needs  and  available  resources  particular 
to  each  State.  The  truth  of  this  statement  is  demonstrated  by 
the  wide  variance  in  State  program  delivery  strategies. 

The  decisions  with  respect  to  each  operational  effort  must  be 
classified  as  "assumptions,"  not  to  denigrate  the  thoughtful - 
ness  of  program  decision  makers,  but  rather  due  to  the  lack  of 
succinct  knowledge  about  health  program  impact  and  efficient 
methods  of  service  delivery.  In  other  words,  EPSDT  is  an 
experiment  because  there  does  not  exist  a  "science"  of  health 
service  such  that  the  outcome  of  a  particular  policy  (delivery 
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of  comprehensive  care)  or  an  operational  decision  (developing 
screening  clinics)  can  be  predicted  with  any  certainty.  The 
EPSDT  manager,  then,  is  a  social  experimenter  who  must  continu- 
ally evaluate  his  program  and  its  environment  to  determine  the 
real  effects  of  his  decisions  over  time.  Simultaneously,  he 
must  compare  feedback  about  program  effects  with  his  detailed 
program  plans. 

A  model  which  aids  the  program  administrator  in  carrying  out 
his  efforts  is  simply  an  organized  description  of  how  to  search 
out  problems  in  current  program  performance  (evaluation)  and 
determine  opportunities  to  institute  positive  change  to  overcome 
such  difficulties  (planning).  In  this  sense,  evaluation  and 
planning  is  the  primary  ongoing  activity  of  any  organization  or 
system  at  all  levels  of  operation.  In  some  organizations 
evaluation  and  planning  processes  are  formal,  clearly  articulated, 
and  highly  repetitive.  Such  "sophistication"  occurs  in  situa- 
tions where  the  outcome  of  each  action  in  the  process  is  highly 
predictable  and  hence  allowsproblem  sources  to  be  rapidly 
determined  and  corrected. 

In  social  programs  the  evaluation  and  planning  process  is  less 
formal  and  will  likely  appear  as  a  set  of  episodic  enquiries 
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and  disjointed  activities  rather  than  as  an  ongoing  process. 
For  example,  EPSDT  program  administrators  who  were  collecting 
data  describing  the  status  of  their  programs  and  making  deci- 
sions based  on  that  information  were  in  general  not  inclined 
to  define  their  activities  as  comprising  an  "evaluation  and 
planning  system."  Despite  this,  each  could  describe  specific 
methods  for  extending  program  performance  and  initiating  change. 

1.2   PROBLEMS  IN  JOINT  FEDERAL/STATE  EVALUATION  OF 
HEALTH  PROGRAMS 

Given  the  unpredictable  nature  of  social  programs,  the  develop- 
ment of  planning  and  evaluation  systems  is  typically  an  effort 
fraught  with  problems.  Attempting  to  develop  a  model  which 
addresses  local,  State,  and  Federal  concerns  and  accommodates 
widespread  variation  in  program  efforts  guarantees  even  greater 
difficulties. 

A  review  of  attempts  to  develop  planning  and  evaluation  systems 
for  programs  like  EPSDT  (e.g.,  CSY  evaluation  systems,  Head  Start 
evaluation,  contemplated  demonstrations  for  EPSDT  evaluation 


1.  Bokonon  Systems,  Inc.,  EPSDT  State  and  Local  Planning  Issues:  A 
Conference  Report  (Washington,  D.C.,  March  1975). 
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2 

systems,  etc.)  reflected  poorly  on  past  efforts.   Existing 

planning  and  evaluation  systems  were  unsuccessful  whether  viewed 
on  the  basis  of  their  ability  to  improve  program  performance  or 
using  even  more  limited  measures  such  as  "improving  smoothness 
of  program  operations." 

Typically  the  planning  and  evaluation  systems  reviewed  were 
developed  at  the  Federal  level.  Moreover,  in  general  these 
systems  ignored  the  interrelationships  between  planning  and 
evaluation  and  focused  on  Federal  information  needs.  These 
systems  usually  directed  their  attention  to  general  comparisons 
of  local  .program  performance  and  output  to  the  detriment  of 
supporting  requirements  of  local  projects  who  supplied  services 
and  data  (e.g.,  the  models  did  not  assist  local  projects  in 
solving  their  problems  with  scheduling,  billing,  quality  con- 
trol, etc.).  By  definition,  the  exclusion  of  local  concerns 
made  these  models  noncomprehensive. 

At  the  same  time,  to  permit  rapid  Federal  comparisons  of  local 
project  performance  rigid  data  elements,  data  flows,  and 


2.  Bokonon  Systems,  Inc.,  Evaluation  of  Delivery  of  Preventive  and 
Pediatric  Health  Services  and  Case  Management  Systems:  Literature 
Analysis  (Washington,  D.C.,  1974). 
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computation  requirements  were  mandated  upon  the  local  level. 
These  demands  were  viewed  as  irrelevant  by  local  project  per- 
sonnel and  the  Federally  mandated  systems  came  to  be  seen  as 
inflexible  and  contravened  individual  local  attempts  to  manipulate 
data  for  their  own  purposes. 

While  sufficient  funds  for  operation  of  such  systems  were  provided, 
lack  of  concern  for  and  involvement  of  local  project  personnel 
in  their  design  guaranteed,  over  time,  that  the  systems  would 
be  infeasible.  These  findings  thus  led  to  a  formulation  of 
policy  guiding  the  development  of  the  EPSDT  planning  and  evalua- 
tion model.  The  specific  policies  by  which  this  model  has  been 
produced  include: 

Comprehensiveness 

Development  of  the  EPSDT  Model  was  based  upon  the  simultaneous 
examination  of  the  full  range  of  EPSDT  information  needs  of 
administrators  at  Federal,  State,  and  local  levels.  No  attempt 
was  made,  a  priori,  to  ignore  functional  or  information  require- 
ments not  fitting  under  traditional  categories  of  "operational" 
or  "compliance"  as  opposed  to  "evaluation"  or  "planning"  needs. 
This  effort  viewed  all  data  and  functions  necessary  for  program 
improvement  as  evaluative  in  nature. 
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Relevance 

Relevance  was  sought  by  rigorous  identification  of  EPSDT  objec- 
tives, roles,  functions,  and  problems.  The  source  of  input  for 
such  determinations  was  key  personnel  at  the  local,  State,  and 
Federal  levels.  Federal  personnel  were  not  allowed  to  dictate 
their  perceptions  of  "local  needs."  At  each  level  appropriate 
personnel  were  asked  to  articulate  the  value  of  information  or 
issues  proposed  in  terms  of  relevance  to  program  improvement. 

Flexibility 

Requirements  for  flexibility  are  dictated  by  the  extent  of  local 
and  State  project  variability,  as  well  as  the  difficulty  of 
accurately  predicting  possible  outcomes  of  all  EPSDT  activities. 
State  variability  extends  beyond  differences  in  service  delivery 
modes  to  include  State  evaluation  capabilities,  management  style, 
and  the  political  forces  shaping  analytic  issues.  These 
realities  militate  against  specification  of  laundry  lists  of 
issues  or  precise  data  requirements  and  analysis  modes. 

Feasibility 

The  analysis  of  past  efforts  to  evaluate  Federally  supported 
health  programs  indicates  that  feasibility  is  as  much  an  issue 
of  insuring  local  ownership  and  interest  in  data  collection  as  it 


-8- 

is  one  of  technical  design.  This  belief  underscored  emphasis 
on  early  and  direct  involvement  of  State  and  local  personnel 
in  model  development  and  maintenance  of  a  general,  flexible 
approach  to  model  design.  On  a  technical  level,  feasibility 
through  flexibility  was  sought  by  utilizing  the  "data  classifica- 
tion" as  opposed  to  "data  specification"  approach. 

1.3   DATA  CLASSIFICATION  APPROACH 

A  corollary  to  recognition  of  State  programmatic  variation  is 
recognition  of  real  differences  in  technical  approaches  and  capa- 
bilities for  data  collection,  storage,  and  analysis.  The  local 

3 
level  analysis  of  EPSDT  efforts  indicated  that  although  a 

plethora  of  data  was  collected  relevant  to  evaluation  of  EPSDT,  it 

was  defined,  assembled,  and  stored  in  different  fashions.  Thus, 

to  use  the  typically-employed  approach  to  Federal  data  collection 

(i.e.,  reliance  on  exact  specification  of  data  element  definition 

and  compilation)  would  place  unreasonable  burdens  on  local  data 

generators. 

As  an  alternative  to  standard  Federal  practices,  the  evaluation 
strategy  which  has  been  developed  allows  States  and  localities 


3.  Bokonon  Systems,  Inc.,  EPSDT  Status:  A  Review  of  Eight  States 
(Washington,  D.C.,  December  1974).  ------ 
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to  maintain  current  methods  of  data  element  definition  and 
storage.  Inter-project  and  inter-State  comparisons,  as  well 
as  mounting  of  the  State  systems  proposed  by  this  model,  are 
permitted  by  a  process  of  "classifying"  currently  collected 
data  in  terms  of*  more  general  information  needs. 

The  model  has  been  articulated  by  a  series  of  reports  which 
reflect  short-term  planning  and  evaluation  issues.  These  output 
reports  can  be  prepared  using  minimal  data  sets  which  are 
generally  in  place  at  State  and  local  levels.  It  is  therefore 
expected  that  existing  State  and  local  data  systems  can  be 
utilized  with  minimal  change. 

The  hallmark  of  the  data  classification  system,  namely  organiza- 
tion of  data  by  critical  categories,  can  best  be  explained  by 
example.  One  output  in  screening  which  serves  as  an  indication 
of  health  status  of  the  population,  as  well  as  an  indicator  for 
D&T  referrals,  is  that  data  reported  under  the  general  category 
of  "screening  findings."  The  term  "screening  findings"  reflects 
a  generic  classification  with  the  level  of  detail  left  to  the 
discretion  of  each  particular  program  manager.  The  analyses 
which  permit  one  to  assess  the  effects  of  the  screening  efforts 
may  be  applied  irrespective  of  the  level  of  data  detail.  So, 
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for  example,  one  State  which  reports  its  findings  in  terms  of 
the  gross  screening  definitions  mandated  by  the  legislation-- 
i.e.,  dental,  hearing,  vision,  other--may  examine  its  program 
status  using  the  level  of  data  available.  Another  State  whose 
data  is  highly  detailed  (e.g.,  screening  findings  are  reported 
according  to  ICDA-8  codes)  can  also  apply  the  same  general 
analyses.  The  data  classification  approach  offers  the  oppor- 
tunity for  improving  planning  and  evaluation  capabilities  without 
demanding  the  massive  reorganization  of  locally  developed 
systems  at  a  prohibitive  cost. 

1.4   FUNCTIONAL  USE  FOR  THE  MANUAL 

Effective  evaluation  and  planning  in  EPSDT  results  from  determin- 
ing the  degree  to  which  changes  in  program  status  occur.  To 
facilitate  the  necessary  comparisons  this  manual  is  organized 
into  chapters  in  which  the  problems  associated  with  EPSDT  are 
discussed  and  a  series  of  reports  which  can  be  used  to  determine 
the  degree  of  change  in  program  status  are  presented.  EPSDT  is 
viewed  in  terms  of  the  following  categories: 

Eligibility 

Screening 

Diagnosis  and  Treatment 

Quality  Assurance 

Costs  and  Claims  Payment 
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The  organization  of  these  reports  within  each  category  and 
their  relationship  to  each  of  the  problem  issues  are  presented 
in  Figure  1.  A  project  manager  having  specific  concerns  in 
any  of  these  areas  may  refer  to  the  appropriate  chapter  leaving 
other  chapters  for  later  examination.  Each  chapter  is  organized 
around  critical  issues.  The  reports  serve  to  provide  organiza- 
tion of  data  so  that  the  issues  may  be  resolved.  In  addition, 
specific  analyses  which  may  prove  useful  also  appear. 

Two  final  chapters  deal  with  long-range  planning  and  procedures 
for  implementation  of  the  report-oriented  planning  and  evalua- 
tion system.  The  chapter  on  long-range  planning  provides  a 
series  of  algorithms  which  the  project  manager  may  use  to 
determine  long-range  demand  of  the  program  and  to  estimate  costs. 

Methods  for  implementation  are  simply  stated  and  use  of  this 
section  will  depend  upon  the  degree  to  which  States  or  local 
projects  are  already  functioning  in  a  planning  and  evaluation  mode, 


-12- 


o 


r—    O             J= 

4J 

1/1     >>             O! 

Li    L    91    c 

-    fl    ff  Ol 

uj    E 

cc 

OO    3    >-,  >i 

L.I 

OO  OQ  OQ 

1 — 

(— 

Q. 

a. 

*j   3        o:   ID 

C     E     CTIUJ    E     Ol   TO 

s:  o  _ j       o  —j  oo 


<_><*-  •.-  z  ^. 

O    w*i  UJ    l/l 


to  cj  •*-   u 
c  oo  -o  c 


I—  1/1  >  — 


CI—     3TL-U    VI 


UJ    TO 

•o         >< 

C£     3 

0)    vl  « — 

<_>  +J 

VI     UJ     TO 

(/I    O 

o  u  c 

•X 

—  1-  «* 

O    3 

01 

o    >, 

> 

f>  vi 

'■'-     00    •■—■ 

<u         > 

(!) 

O          1- 

>>*■> 

E  oo 

<= 

>>"— 

I—    TO 

•r-    UJ   "O 

•»- 

l/l  1 —  »f- 

+->   re  Q£  -f—  "o 

C     Q.UJ     (.'I     C 
O    rt3  t/)    O  t- 


<_j(  a: 


<vJ  J3    UO    "3  JJ     U  T3     0JO    ro  -Q 


UJ 

oc 

^— 

c*3 
co 

CO 

o 

< 


UJ 

i — 


1—3  0)    9)  > 

=n  -u        i/>  t. 

O    U  O     TO 

«*  r—  <_)  ■ 


I  >  lO    l/>  <*-  O  ♦-> 

•i-OI  >    O)    O         i- 

l    >>•"    E  OO  E  l/l  f— 

I  < —    TO  *t-    UJ  "O  •—    l/l  01 T- 

•-=  —  (—•—    CI—    3  OJ3 

:  *J  3  q:  to  u  l« 
i  c  E  oiuj  e  en  to  3  D. 
i03tooooito+joto 

2:<->_l  QJVllOO 


Ol0i3UOQJ3U,u4l 


UJ 


00 

CO 


0)    Ol 

1 —    VI 

JO    TO 

f-    O 

Ol 

1-   c 

h- 

ai 

1 

1/1    01 
•r-    Ol 

c 

cs 

0  to 

j=  j= 

tn 

3  <J> 

Q  O0  Q  o 


r-Mm<s- 


-o   >i  E 

C  r—     O 


Q_ 

CO 

Z_ 

<=c 

I 

t-J 

oa 

00 
1 — 
00 
o 

CJ> 


QUALITY  ASSURANCE 


00 

UJ 

SL 
>- 

■=: 

Q_ 
CO 


CO 
CD 


3T 

fc. 

UJ 

0 

(.3 

s- 

<■ 

s. 

*Z 

Ul 

< 

£ 

in 

E  i/> 

0-1 

•f-  ■*-» 

?- 

01 

<a  c 

B 

>—  01 

<Z 

"S 

_l 

(— 

(_) 

h-   </» 

01 

»a  3 

TO     Ol 

a  ■<-» 

-1  S 

■a 

cn 

*<s 

Oil— 

Ol 

oo 

c 

C  oQ 

UJ 

•r-  0 

c  to 

C    U) 

ex. 

01  — 1 

01  s- 

LU 

01 

0)  0 

OO 

s-  H- 

I-   s. 

O  oO 

0  <- 

I-U1Q 

<Si  UJ 

cu 
•0 
o 
2: 

■o 

<u 
-(-> 
c 
<u 

si 

o 

4J 

S- 

o 

o. 

en 


a. 

nn  ut: 

+J 

UJ 

0: 

03 

ZJ 

to 

> 

LU 

1— 

UJ 

■D 

S 

£= 

C.3 

(0 

<: 

z 

CD 

c 

-j 

•l«* 

c 

i/i 

c 

u. 

+j 

*j  01 
01  01 

r— 

^ 

0  -o 

U    3 

Q. 

UJ 

CO 

u 

1— 

u 

<u 

+J 

C 

1 

■0 

Ol 

h- 

■a  to 

JC 

C> 

DC 

0  > 

> 

•tJ  -o 

C3 

0 

Ol 

e 

3 

I 

1/1  &.  in 

u 

Ol  O  CO 

to 

uo 

+j  01  -u  a.  «C  3E 

1/1  a.  wi 

0        0 

=S  >1 

3 

J'DU  JJJJ  J3 

> 

CO 

C 

to 

Oi  n3    CT 

VI 

vt 

VI 

C/1 

to 

OO 

C            C 

4-> 

•<-> 

4-> 

+J 

UJ 

VI 

v> 

VI 

l/l 

c  <a  c 

0 

0 

O 

0 

ae 

cu  .r-   01  (->  CJ  <_)  <J 

UJ 

01  ■*■*  01 

1 — 

</1 

U  v-  s. 

h- 

h- 

1— 

1— 

Q 

u  c  0 

o^l 

oO  o0 

•a 

I—  oo  •— 1  oo  <z   : 

CO 

cc 

^..^^^ 

^^ 

D_ 

a. 

(o  ja  u  td 

Ol  <+- 

01 

LU 

UJ 

t_) 


c/; 

CO 


ar- 
il. 

t- 
D 

•a 

HL 
C_) 


LU 


cs 
1— 1 
u_ 


CHAPTER  II:  ELIGIBILITY 
2,0  Eligibility  Issues 

The  planning  and  evaluation  issues  in  eligibility  are: 

1  .      Who  is  eligible? 

2.      Is  eligibility  case  load  increasing  or  decreasing? 

2.1      OVERVIEW 

The  determination  of  who  is  eligible  to  receive  EPSDT  services 
is  critical  to  all  program  operations.  These  figures  in  fact 
serve  as  the  basis  for  all  future  operations  as  well  as  planning 
and  evaluation.  Eligibility  determination  for  Title  XIX,  however, 
is  rarely,  if  ever,  the  direct  responsibility  of  the  EPSDT  unit. 
On  the  contrary,  typical  State  and  local  arrangements  are  those 
in  which  such  tests  required  for  eligibility  determination  are 
accomplished  by  income  maintenance  units  specializing  in 
eligibility  procedures.  Consequently,  the  EPSDT  program  manager 
must  find  direct  ways  of  relating  to  the  unit  responsible  for 
eligibility  determination  to  ensure  that  accurate  information 
is  provided. 
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2.2   REPORTS 

The  basic  unit  of  information  for  the  EPSDT  unit  manager  is 
"Who  is  eligible?".  Report  Series  1,  Eligibility  Reports , 
presents  detailed  listing  of  recommended  eligibility  tabulations. 
The  first  critical  number  required  by  the  project  manager  is  a 
count  on  a  regular  basis  of  the  total  size  of  the  eligible 
population.  Since  most  States  are  organized  into  regions, 
districts,  or  counties  for  Title  XIX  operations,  the  first  report 
the  EPSDT  unit  manager  needs  to  address  is  one  which  provides  an 
indication  of  total  case  load  broken  down  by  Title  XIX  jurisdic- 
tions in  the  State.  A  format  for  this  is  presented  in  Table 
1(a),  Total  Count  Summary.  This  table  should  be  prepared  on 
a  monthly  basis  so  that  the  project  manager  may  assess  increases 
and  decreases  in  caseload  trends  over  time. 

Note  that  the  State  total  provides  a  net--i.e.,  those  that  are 
eligible  at  the  present  moment--as  well  as  a  nonduplicated  count 
to  date.  This  last  column  indicates  the  total  number  of  people 
eligible  against  which  ongoing  comparisons  on  service  delivery 
will  be  made.  The  county  summary  not  only  provides  the  unit 
manager  with  an  indication  of  his  total  but  also  reflects  changes 
between  counties  (transfers)  which  may  have  occurred.  Copies  of 


-15-' 


>- 


oo 


o 
o 


< 
o 


o 

O- 
LU 
CC 

>- 


CO 

I— I 

I— I 

_J 

UJ 


s- 

03 
GJ 


+J 

c: 

o 


O) 

T3  +-> 

CO    03 

■4->  Q 

03 

O    O 

CM 

•1-  4-> 

CO 

^~ 

CO 

CL+J 

•t 

3    C 

r-^ 

■O    3 

«* 

C    O 

^— 

ID  C_> 

JC  1— 

4->    03 

tO 

C  -t-> 

un 

O    O 

co 

S  h- 

9% 

CO 

-O  +-> 

CM 

C    OJ 

^— 

UJ  2: 

l/> 

e 

0 

s- 

0 

•r— 

CU  1— 

ID 

■M 

>  CM 

to 

O 

O 

0\ 

rtJ 

CO 

c/) 

to 

C 

03 

cn 

c 

S- 

"1— 

i— 

t/l 

O 

a> 

>> 

^— 

r— 

O 

-Q 

0 

-C 

+J  -r- 

ID 

+-> 

0  cn 

tO 

c 

2Z    •!- 

#> 

0 

r~ 

"3" 

s: 

UJ 

tO 

Cn 

2  c 

O 

OJ    •!- 

m 

2:  c 

to 

CU 

A 

Q. 

00 

O 

to 

C  -C 

O 

•1-  +J 

O 

Cn  C 

A 

OJ    O 

CO 

co  2: 

OJ 

<U     !— 

■M    03 

TCI   -M 

-M    O 

to  t— 

CD 

T3  +-> 

CD    03 

4->  O 

03 

a    O 

cn  cm 

•1-  4-> 

r—  CO 

1 — 

CO  tO 

CL4-> 

•>      •> 

3    C 

1—  LO 

-a    3 

r— 

C    O 

id  O 

1            j 

x:  1— 

■M    ra 

cn  co 

C   4-> 

to  r-» 

0  0 

«3-  r--» 

2:  t— 

en  *3- 

-a  -m 

c  cu 

ui  2: 

+j 

to 

3 

tO  CM 

S- 

0 

I—  *3- 

d) 

4- 

to 

c 

03 

S- 

1— 

c 

LC)  1— 

1— H 

«^-  CM 

to 

c 

0 

s_ 

O  <J0 

•r- 

CD   r— 

1—  r-» 

+-> 

>  CM 

«*  CO 

O 

0 

rt3 

to 

l/> 

c 

03 

CD 

c 

s- 

•■■- 

1— 

to 

0 

a> 

>, 

^~ 

r— 

0 

J3 

CM  O 

-C 

■M    •!- 

1 —  to 

+J 

O    CD 

CO 

c 

2:  t- 

0 

r— 

2: 

UJ 

l/l 

cn 

S  c 

CM  CO 

aj  •■- 

p—  r— 

2:  e 

00  LO 

OJ 

Q. 

O 

O  CM 

C  -C 

ID  r— 

•r-   +J 

co  r- 

CD   C 

A        M 

CD     O 

00  ^r 

co  2: 

>> 

>>  s_ 

+->    03  3 

^^ —  cm     •  cn 

3    E 

OO     •  cn 

O     3 

O  <S) 

+J 
i_ 
o 

Q. 
OJ 

S- 

■o 
c 
aj 

* 


«3 

E 
E 
3 
to 


c 
3 
o 
t_> 


03 
■M 
O 


i- 
O 
Q. 

a; 
or 


•r— 

cn 


03 


to 
CU 

S- 
CD 
CO 


o 

Q. 
O) 

cc: 


-16- 

this  report  should  be  made  available  to  area  managers  responsible 
for  EPSDT  so  that  they  too  may  have  full  understanding  of  the 
changes  within  their  jurisdictions. 

Table  No.  1(a)  may  be  sufficient  for  program  operations, 
particularly  in  States  which  do  not  differentiate  screening 
requirements  by  age.  For  States  which  do  differentiate  screening 
requirements  by  age,  a  second  level  breakdown  is  recommended. 
Consequently,  Report  1(b),  Age  Analysis,  has  been  prepared. 
All  caseload  transactions  are  presented  by  age  category.  Age 
categories  chosen  should  reflect  the  differential  screening 
standards  established  in  the  State. 

Many  States  have  screening  requirements  for  their  total  popula- 
tion irrespective  of  age.  It  is,  however,  important  that  the 
State  be  aware  of  the  ages  of  its  eligible  population  insofar 
as  service  delivery  demands  (i.e.,  amount  of  time  necessary  for 
screening)  vary  with  age.  This  is  of  particular  importance  in 
those  States  which  contract  out  services  to  their  Public  Health 
Department,  since  this  type  of  breakdown  will  aid  the  Public 
Health  Department  in  its  own  planning  efforts  to  ensure  appropri- 
ate delivery  of  screening  services.  As  with  the  total  summary, 
breakdown  by  county  should  be  obtained  and  copies  offered  to  local 
unit  chiefs. 
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The  final  eligibility  report,  Table  1(c),  Length  of  Stay,  presents 
an  analysis  of  eligibles  by  age  and  by  length  of  stay.  Included 
in  this  report  is  a  presentation  of  cases  closed  by  length  of 
stay  and  age.  The  importance  of  this  information  is  twofold. 
Since  the  intent  of  the  program  is  to  introduce  children  to  com- 
prehensive health  services  with  the  expectation  that  these  will 
be  maintained  subsequent  to  eligibility,  knowledge  of  distribution 
and  length  of  stay  will  help  in  establishing  priorities.  Age 
and  length  of  stay  are  also  important  factors  to  the  unit  manager 
who  is  responsible  for  determining  periodicity  rates.  Such 
information  will  help  him  to  estimate  the  number  who  will  continue 
to  remain  eligible  to  receive  periodic  screenings.  A  more 
detailed  discussion  of  the  consequences  of  eligibility  turnover 
and  periodicity  on  program  operations  will  be  presented  in  sub- 
sequent sections. 


2.3   ANALYSES 


Data  required  for  eligibility  determination  are  straightforward 
counts  of  present  and  unduplicated  numbers.  No  special  analysis 
need  be  considered. 
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2A      SUMMARY 

Central  to  the  evaluation  of  the  EPSDT  program  is  an  accurate 
picture  of  eligibility  status.  It  is  recommended  that  data 
obtained  from  those  responsible  for  eligibility  determination 
be  tabled  to  reflect  types  of  transactions  which  affect  the 
eligible  population  as  well  as  by  locality.  It  is  further 
recommended  that  such  data  be  organized  by  age.  Given  this 
information,  the  program  administrator  can  observe  those  events 
which  affect  his  eligible  population  and  consider  the  implica- 
tions of  changes  in  the  population  on  the  rest  of  his  EPSDT 
activities. 


CHAPTER  III:  SCREENING 


3.0  Screening  Issues 

The  planning  and  evaluation  issues  in  screening  are: 

1  .  VJhat  is   the  demand  for  screening? 

2.  What  is  the  supply? 

3.  How  well   is   the  demand  being  met? 

4.  What  are  the  results  of  screening? 

3.1  OVERVIEW 

The  central  objective  of  State  and  local  screening  efforts  is  to 
meet  the  demand  for  initial  and  periodic  screening  services. 
Accordingly,  the  issues  in  evaluation  focus  on  determining  screen- 
ing demand  and  obtaining  sufficient  supply  (provider  services) 
to  meet  that  demand.  Consequently,  evaluation  efforts  can  be 
directed  to  comparison  of  the  supply/demand  capability  with 
actual  screening  efforts. 

In  reality,  screening  demand  is  affected  by  a  number  of  target 
population  characteristics  which  are  not  always  under  the  control 
of  the  EPSDT  program  or  Medicaid  generally.  In  particular,  the 
following  must  be  considered: 
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1.  Initial  number:  For  those  States  in  which  EPSDT  implementa- 
tion has  been  slow,  providing  service  to  the  initial  number 
of  eligibles  may  constitute  a  long-term  problem  when  con- 
sidered in  light  of  supply  available  (i.e.,  resources  in 
terms  of  dollars  and  provider  availability). 

2.  Equivalence:  Given  the  initial  number  of  eligibles,  it  is 
inappropriate  to  make  the  assumption  that  none  of  these 
children  are  receiving  services.  Certainly  Medicaid  payments 
have  been  and  continue  to  finance  services  for  children  in 
the  0-21  year  range.  In  any  event,  those  who  are  being 
serviced  by  pediatricians  are  probably  receiving  services 
similar  to  that  mandated  by  the  legislation.  In  addition, 
the  proliferation  over  the  last  10  years  of  Title  V  Programs, 
most  of  which  are  also  directed  toward  this  eligible  popula- 
tion, clearly  suggests  that  many  of  the  eligibles  who  are 
introduced  into  the  program  are  already  receiving  equivalent 
services.  Consequently,  determination  of  equivalence  is  a 
critical  program  variable. 

3.  Eligibility  requirements:  The  question  of  who  is  eligible, 
how  long  they  remain  eligible,  and  how  frequently  they  re- 
appear as  eligibles  constitutes  a  major  problem  in  determin- 
ing demand. 
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4.  Declines:  EPSDT  programs  have  historically  had  difficulty 
with  no-shows.  There  appear  to  be  a  number  of  reasons  for 
this.  In  the  first  place,  there  are  members  of  the  eligible 
population  who  are  affiliated  with  health  programs  or  with 
providers  in  whom  they  have  confidence.  While  many  of  these 
recipients  may  be  coerced  into  making  appointments  they 
rarely  take  advantage  of  the  service.  Consequently,  the 
question  of  equivalence  becomes  important  in  reducing  screen- 
ing declines. 

A  second  important  reason  for  no-shows  lies  with  technical 
difficulties  associated  with  the  mobility  of  the  poor. 
Certainly  in  a  rural  area  which  lacks  a  transportation 
system  one  would  expect  a  high  incidence  of  no-shows.  It 
is  the  responsibility  of  the  program  manager  to  determine 
whether  or  not  there  is  a  necessity  for  obtaining  support 
services  for  specific  localities  which  have  high  no-show 
rates  within  his  jurisdiction. 

Finally,  there  are  those  whose  attitudes  toward  the  program 
may  be  negative  due  either  to  a  lack  of  credibility  on  the 
part  of  the  EPSDT  agency  or  the  recipient's  own  lack  of  under- 
standing of  the  importance  of  the  services  being  offered. 
Evaluation  will  identify  the  level  at  which  eligibles 
decline  services  (i.e.,  decline  rate).  It  will  not, 
however,  provide  the  program  administrator  with 
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the  reasons  for  that  decline  rate.  His  responsibility  is 
to  further  investigate  specific  situations  so  that  he  may 
obtain  solutions  to  the  problems  illuminated  by  his  evalua- 
tion efforts. 

On  the  supply  side  as  well  as  with  the  demand  side,  the  ability 
of  EPSDT  program  units  to  affect  supply  may  be  limited.  For 
example,  the  State  may  influence  provider  participation  through 
fee  schedules,  claims  turnaround,  etc.,  but  it  will  be  rare  that 
the  State  can  increase  the  total  number  of  providers  available. 

Given  the  factors  which  influence  both  demand  and  supply,  the 
problem  of  evaluating  and  improving  screening  efforts  is  more 
complex  than  simply  examining  the  State's  "screening  rate" 
(number  screened  divided  by  the  number  of  eligibles). 

Federal  requirements,  however,  still  necessitate  that  these  gross 
measures  be  reported,  and  State  performance  is  consequently  gauged 
by  these  measures.  Careful  consideration  of  the  report  series 
presented  in  this  section  will  aid  the  program  administrator  in 
determining  the  reasons  for  failures  (e.g.,  low  screening  rates 
in  rural  areas,   provider  scarcity  areas,  etc.)  in  a  manner  which 
opens  the  problems  for  consideration  and  subsequent  solution 


-25- 


(e.g.,  rural  areas  may  need  transportation  or  to  be  serviced 
by  mobile  clinics;  States  may  choose  to  transport  children 
from  provider  scarcity  areas  or  offer  subsidies  to  providers 
who  will  service  them  or  develop  other  means  of  service 
delivery) . 

Finally,  examination  of  screening  findings  will  serve  as  the 
basis  for  referral  analysis  of  D&T  capabilities  as  well  as 
the  basis  for  future  planning.  In  addition,  listing  screening 
findings  by  location  will  improve  State  capability  in  local 
health  planning. 


3,2   REPORTS 


The  evaluation  of  screening  capability  appears  straightforward 
at  first  consideration.  The  unduplicated  eligibility  count 
provides  the  size  of  the  initial  screening  population.  Conse- 
quently, it  would  appear  that  the  rate  at  which  eligibles  are 
screened  would  provide  a  clear  indicator  of  the  status  of 
screening  efforts.  However,  the  eligible  population  is  affected 
by  equivalence,  openings  and  closings  (turnover),  declines,  and 
finally  by  capability,  namely  the  ability  of  providers  to  offer 
services.  The  Federal  government  nevertheless  requires  an 


-26- 

overview  of  screening  on  the  basis  of  total  eligibles  versus 
total  screened.  Consequently,  we  have  organized  these  reports 
to  reflect  the  following  categories: 

-disposition  of  screening  demand 

-screening  trends 

-screening  results. 

Disposition  of  Screening  Demand 

Report  Series  2,  Disposition  of  Screening  Demand, allows  for 
examination  of  unscreened  eligibles. 

Report  2(a)  recommends  a  format  for  displaying  a  monthly  demand 
total  for  the  State  as  well  as  for  each  administrative  jurisdic- 
tion (in  the  example  given,  a  county).  This  format  permits  the 
program  administrator  to  observe  monthly  changes  in  demand  and 
their  basis  (e.g.,  turnover,  etc.)  on  a  county-by-county  basis. 
The  assumption  in  this  particular  presentation  is  that  the  State 
had  not  established  screening  quotas.  However,  the  same  form 
might  be  used  with  established  screening  quotas  listed  by  age 
so  that  the  program  manager  may  determine  the  degree  to  which 
each  county  level  is  meeting  its  quotas. 
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While  the  monthly  figure  is  critical  to  the  EPSDT  program 
manager  to  ensure  that  the  demand  is  not  increasing,  it  is  also 
important  that  he  have  an  overview  of  his  total  initial  and 
periodic  service  requirements.  Consequently,  a  cumulative  total 
of  screening  efforts  during  the  year  must  also  be  prepared. 
While  Report  2(b)  only  presents  a  format  for  displaying  State 
totals, the  same  data  may  be  compiled  for  local  jurisdictions  to 
provide  local  project  managers  with  similar  information. 

Report  2(c),  Length  of  Time  Between  Eligibility  and  Screening, 
provides  the  program  manager  with  a  clear  picture  of  length  of 
time  which  has  elapsed  between  eligibility  determination  and 
screening.  This  same  chart  may  be  prepared  for  each  county  on 
a  monthly  basis  as  well.  Such  an  indication  may  serve  to  aid  the 
program  manager  in  identifying  those  counties  in  which  difficul- 
ties have  arisen. 

Screening  Trends 

Report  Series  3,  Screening  Trends,  describes  trends  in  screening 
efforts.  These  reports  are  more  useful  evaluation  indicators  than 
the  cumulative  data  presented  in  the  demand  disposition  series. 
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Report  3(a),  Demand  Versus  Actual  Screening,  allows  the  program 
manager  to  observe  changes  in  demand  and  changes  in  screening 
as  a  function  of  time.   In  addition,  a  rank  order  for  each  county 
is  obtained  for  each  month.  Changes  in  rank  order  over  time  provide 
an  indicator  of  change  in  local  performance. 

A  similar  trend  analysis  format  is  recommended  to  examine  timeli- 
ness of  screening  services  in  Report  3(b).  It  is  suggested  that 
this  data  be  broken  out  by  jurisdiction  and  that  rank  order  be 
determined  so  that  changes  in  rank  order  may  serve  as  rapid 
indicators  of  problems. 

Report  3(c),  Status  of  Closed  Cases,  provides  a  picture  of  the 
disposition  of  closed  cases.  This  is  of  particular  concern  for 
States  which  maintain  continuity  of  caseloads  through  assignment 
of  recipient  numbers  which,  once  established,  remain  constant. 
This  data  provides  the  project  manager  with  the  ability  to  dis- 
tinguish the  number  of  closings  that  occur  without  having  been 
screened.  If  this  data  is  available,  then  methods  can  be  developed 
which  will  ensure  reduction  in  duplication  of  screening  services 
to  those  who  show  rapid  turnover  in  eligibility  (short  on 
and  off  periods  of  eligibility). 
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The  program  administrator  also  requires  an  indication  of  who  is 
providing  screening  services.  Such  a  presentation  is  offered 
in  Report  No.  3(d),  Monthly  Sources  of  Care.  This  data  may  also 
be  tabled  for  local  areas  and  used  to  indicate  service  scarcity. 

The  most  critical  evaluation  report  is  that  presented  in  3(e), 
Monthly  Screening  Capability  Analysis.  This  report  provides  a 
realistic  picture  of  the  State's  efficiency  and  effectiveness  in 
providing  screening  services.  Algorithms  for  determining 
available  provider  stock,  participating  stock,  and  units  are 
available  in  Section  3.3,  Analyses.  Basically,  "available 
provider  stock"  are  all  facilities  in  the  area  adjusted  to  their 
estimated  ability  to  provide  Medicaid  services.  "Participant 
stock"  are  those  providers  who  can  be  identified  as  participating 
in  the  EPSDT  program.  "Estimated  units  available"  are  the  expected 
number  of  service  units  participating  stock  may  provide.  In  the 
case  in  point,  we  have  indicated  a  reduction  in  demand  as  a 
result  of  screening  but  also  have  suggested  the  more  efficient 
use  of  units  available  would  reduce  demand  even  further. 
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Screehing  Findings 

Report  Series  4,  Screening  Findings,  presents  recommendations  for 
tabling  screening  results.  Report  4(a)  is  a  straightforward 
presentation  of  positive  findings  which  also  serves  as  an  indica- 
tion of  referrals.  This  same  report  may  be  prepared  on  an  area- 
by-area  basis  to  allow  the  project  manager  more  flexibility  in 
observing  performance  within  local  jurisdictions.  The  report  is 
organized  according  to  standard  screening  categories  recommended 
by  EPSDT  guidelines.  The  same  general  format  can  be  used  by 
States  which  categorize  medical  problems  by  codes  by  simply 
expanding  the  format  to  accept  the  additional  categories. 

Report  4(b)  provides  data  describing  screening  findings  in  terms 
of  incidence  as  well  as  by  age  and  sex.  Changes  in  incidence 
over  time  are  critical  indicators  of  health  status  problems. 
Consequently,  a  similar  report  should  be  prepared  on  a  local 
jurisdictional  basis  so  that  changes  in  incidence  can  be  con- 
sidered. 
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3.3   ANALYSES 

The  analyses  for  determining  demand  and  supply  in  screening 
are  straightforward.  Following  are  calculations  for  demand 
and  supply  as  they  are  related  to  screening. 

Screening  Demand  Calculations 

Initial  demand  and  periodic  demand  are  obtained  somewhat  differ- 
ently. Following  are  equations  for  both: 


Initial  Screenina  Demand  =  [UE  -  E  -  E  -  C  1+  [CCO  -  E  -  D  -  C  ] 
isn  "  l     u   u   u J   L      co   co   coJ 

Where:  UE  =  the  number  of  unscreened  eligibles  =  total  eligibles 
minus  screened  eligibles 

E  =  eligibles  who  have  obtained  equivalence  according  to 
the  standard  set  by  the  State 

D  =  unscreened  eligibles  who  have  declined  services  directly 
or  declined  services  by  signing  a  waiver,  or  eligibles 
who  have  declined  services  according  to  the  technical 
no-show  decline  requirements 

C  =  unscreened  eligible  cases  closed  to  date  by  virtue  of 
loss  of  eligibility  or  exceeding  age  21 

CCO  =  number  of  cases  reopened  and  new  openings  during  the 
time  period  (in  the  case  of  within-State  jurisdictions 
children  transferred  into  the  area  must  be  added  to 
this  number)  minus  reopenings  who  are  known  to  have 
been  screened 

E   =  reopenings  and  new  openings  for  whom  equivalence  has 
been  determined 

D   =  reopenings  and  new  openings  who  decline  services  during 
the  time  period 

C   =  reopenings  and  new  openings  whose  cases  have  closed 
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Periodic  Screening  Demand  =  PE  -  E  -D  -C 

P    P    P 

where:  PE  =  number  of  children  eligible  for  periodic  screening 
at  the  beginning  of  the  time  period  plus  the  number 
of  children  becoming  eligible  for  periodic  screening 
during  the  period 

E  =  periodic  eligibles  who  are  under  equivalent  care 

D  =  periodic  eligibles  who  decline  care 

C  =  periodic  eligibles  whose  cases  close  during  the 
p   period 


Supply  Calculations 

Determination  of  screening  supply  is  dependent  upon  the  prac- 
titioner strategy  used  in  a  State  or  locality.  Specifically, 
the  calculations  will  depend  upon  whether  or  not  special 
screening  centers  or  solo  providers  who  conduct  screening 
as  part  of  a  larger  pediatric  practice  are  used.  In  the  case 
of  combinations,  the  problem  is  somewhat  more  difficult. 
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With  respect  to  using  screening  centers,  it  is  recommended  that 

the  contracted  service  determine  the  volume  of  screening  that 

they  can  accommodate  on  a  daily,  weekly,  or  monthly  basis.  These 

estimates  can  subsequently  be  compared  with  units  used  (i.e.,  the 

number  of  screenings  delivered)  and  further  refined  as  necessary. 

In  the  case  of  States  and  localities  which  rely  totally  or 
significantly  upon  solo  providers  to  screen  individual  clients, 
supply  analysis  is  greatly  complicated  since  it  must  be  expected 
that  these  same  practitioners  will  also  provide  diagnosis  and 
treatment  services.  Consequently,  their  availability  for  screen- 
ing must  reflect  an  expected  number  of  D&T  requirements.  In 
that  case,  a  general  algorithm  must  be  applied  as  follows: 


Units  available  for  screening  =  total  units  available  -  [estimated 

demand  for  D&T  +  Medicaid  episodes] 


This  algorithm  assumes  that  practitioners  will  first  meet  the 
demands  for  diagnosis  and  treatment  including  episodic  treatment 
before  their  capabilities  are  counted  as  a  supply  function  for 
screening. 

A  more  detailed  examination  of  elements  affecting  the  demand 
for  D&T  is  presented  in  Chapter  IV,  Diagnosis  and  Treatment. 
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It  should  be  noted  at  this  point,  however,  that  the  demand  for 
D&T  is  a  function  of  the  proportion  of  the  practitioner's  total 
practice  he  is  willing  to  direct  to  Title  XIX  patients,  the 
number  of  eligible  children  presently  under  comprehensive  care, 
and  the  number  of  episodic  visits  that  can  be  estimated  for 
these  children. 

To  develop  the  supply  data  required  by  the  proposed  report  the 
following  supply  variables  must  be  defined: 

-available  provider  stock 

-recruiter  provider  stock 

-units  used 

-estimated  capacity. 

Available  Provider  Stock 

This  number  is  an  estimate  of  the  upper  limits  of  service  avail- 
ability for  Medicaid  eligibles  0-21.  Specifically,  it  is  a  measure 
of  the  degree  to  which  practitioners  are  prepared  to  service 
Title  XIX  periodic  populations.  The  general  algorithm  for  this 
calculation  is: 


Available  provider  stock  =  total  providers  eligible  for  Title  XIX 

x  Medicaid  eligibles  under  21 
total  population 
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This  measure  can  be  further  refined  by  multiplying  available 
provider  stock  by  the  average  number  of  visits  a  provider  can  be 
expected  to  accommodate. 

Recruited  Provider  Stock 

In  those  States  where  physicians  must  contract  with  a  Title  XIX 
Agency  this  number  is  the  actual  number  of  providers  adjusted  by 
their  expected  availability  for  Title  XIX  services.  For  further 
refinement  this  calculation  can  also  be  made  in  terms  of  units 
of  service  available. 

Units  Used 

This  number  is  obtained  by  counting  the  number  of  client  encounters 
billed  to  Medicaid  during  a  specific  time  interval. 

Estimated  Capacity 

This  calculation  is  the  sum  total  of  the  estimated  screening 
units  available  for  the  EPSDT  population. 
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3.4   SUMMARY 

In  summary,  to  carry  out  an  evaluation  of  screening  service  per- 
formance,one  must  appropriately  define  screening  demand  and 
provider  supply  to  determine  program  capability.  Subsequently, 
the  evaluation  and  planning  factors  are  predicated  on  comparing 
capability  (estimated  screening  services  available)  versus  actual 
screening  services  delivered. 

Given  this  ability  the  State  may  then  assess  their  efforts  in 
meeting  their  screening  priorities  across  time  as  well  as  among 
localities.  These  analyses  should  permit  the  determination  of 
success  and  failure  and  therefore  lead  to  planning  for  program 
improvement.  Finally,  the  output  of  screening  services,  namely 
screening  findings,  becomes  a  direct  input  to  future  planning 
for  D&T  services  as  well  as  a  vehicle  for  considering  alternative 
health  service  delivery  models. 


CHAPTER  IV:  DIAGNOSIS  AND 
TREATMENT 

4.0  Diagnosis  and  Treatment  Issues 

The  planning  and  evaluation  issues  in  diagnosis  and  treatment  are: 

1 .  What  is  the  demand  for  D&T? 

2.  What  is  the  supply? 

3.  How  well  is   the  demand  being  met? 

4.1  OVERVIEW 

The  central  objective  of  diagnosis  and  treatment  is  to  meet  the 
demand  for  service  generated  by  positive  screening  findings. 
Accordingly,  issues  in  evaluation  must  focus  on  identifying  the 
demand  for  diagnosis  and  treatment  and  assessing  the  ability  of 
the  supply  system  (provider  services)  to  serve  the  needs  of 
the  recipient  population. 

Evaluation  efforts  should  therefore  be  directed  to  comparisons 
of  the  supply/demand  capability  with  actual  screening  efforts. 
These  comparisons  should  be  carried  out  on  a  State-wide  and  local 
level  basis  over  time.  The  evaluation  system  should  permit  the 
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program  administrator  to  determine  system  failures  in  a  rapid 
fashion  so  that  he  may  move  to  make  corrections.  In  addition, 
the  model  should  also  permit  the  administrator  to  examine  the 
status  of  the  program  in  ways  that  will  illuminate  methods  that 
will  lead  to  improved  efficiency  on  service  delivery. 


4.2   REPORTS 


The  evaluation  of  diagnosis  and  treatment  capability  requires 
displays  which  illuminate  the  factors  affecting  appropriate 
delivery  (i.e.,  timely  client  access  to  appropriate  diagnosis 
and  treatment  services).  To  accommodate  this,  we  have  organized 
report  series  according  to  the  following: 

-diagnosis  and  treatment  demand  disposition 

-diagnosis  and  treatment  trends. 

Diagnosis  and  Treatment  Demand  Disposition 

Report  Series  5,  Diagnosis  and  Treatment  Demand  Disposition, 
provides  recommendations  for  critical  reports  necessary  for  the 
program  administrator  to  determine  the  status  of  the  delivery  of 
diagnosis  and  treatment  services. 
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Report  5(a)  is  an  overview  of  service  requirements  and  their 
effects  on  a  monthly  basis.  This  report  provides  an  indication 
of  outstanding  demand  at  the  beginning  of  the  month  as  well  as 
the  end  of  the  month,  and  the  factors  which  impact  on  demand. 
Diagnosis  and  initial  treatment  have  been  distinguished,  although 
in  many  instances  diagnosis  and  initial  treatment  will  occur 
simultaneously.  Hence  these  categories  may  be  compressed, if 
warranted. 

It  has  also  been  recommended  that  the  data  be  categorized  on 
the  basis  of  two  age  groups  which  most  appropriately  reflect 
age/service  distinctions  in  pediatric  practice.  A  further  sug- 
gestion is  that  a  category  for  completed  treatment  be  prepared. 
In  those  States  which  require  a  treatment  plan  the  determination 
of  these  figures  will  be  relatively  simple.  For  States  not 
requiring  a  treatment  plan,  a  definition  which  best  reflects  the 
State's  estimate  of  completed  treatment  should  be  determined 
(e.g.,  2  or  3  months  with  no  screening- referred  treatment). 

Report  No.  5(b)  presents  a  cumulative  version  of  the  preceding 
data  and  provides  the  program  administrator  with  a  rapid  over- 
view of  the  status  of  D&T  service  delivery  over  time.  This 
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report  should  also  be  prepared  on  a  local  jurisdiction  basis 
to  allow  review  of  local  efforts. 

Report  5(c)  is  a  breakout  of  length  of  time  between  referral 
and  initial  D&T  visit,  based  on  claims  data.  This  report  should 
be  prepared  on  a  local  jurisdictional  basis  as  well  as  for  the 
State  so  that  the  EPSDT  program  administrator  may  be  able  to 
identify  particular  areas  which  are  responsible  for  the  overall 
delays  in  service  delivery. 

Report  Series  6,  Diagnosis  and  Treatment  Trends,  allows  the 
program  manager  to  examine  trends  in  diagnosis  and  treatment 
service  over  time. 

Report  6(a)  is  an  overview  of  demand  and  actual  service  delivered 
for  both  the  State  and  each  local  jurisdiction.  Changes  in  local 
jurisdictional  ranking  will  serve  as  rapid  indicators  of  problem 
areas. 

Report  6(b)  provides  a  model  for  a  trend  analysis  of  delays 
between  referral  and  initial  visit.  This  report  will  provide 
the  EPSDT  program  administrator  with  a  continuous  overview  of 
local  jurisdictions  so  that  problem  areas  may  be  determined. 
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As  with  screening,  it  behooves  the  program  administrator  to  be 
able  to  determine  the  service  status  of  clients  terminating 
eligibility,  Report  6(c).  This  report  is  of  value  for  a  number  of 
reasons.  In  the  first  place  it  gives  him  a  running  record  of 
the  health  status  of  his  terminees  and  can  be  used  to  determine 
whether  or  not  local  areas  are  ensuring  adequate  service  for 
their  population  or  whether  or  not  they  are  waiting  for  turnover 
to  reduce  their  service  demand.  Finally,  the  data  that  provides 
this  information  should  also  provide  a  listing  of  untreated 
referrals  so  that  they  may  be  reconsidered  should  they  reenter 
eligibility  rolls. 

Report  No.  6(d)  offers  the  program  administrator  a  review  of 
who  is  delivering  service  to  his  eligible  population.  This 
information  is  of  importance  to  the  program  administrator  in 
helping  him  to  decide  strategies  for  increasing  or  decreasing 
service  capability. 

Finally,  the  most  critical  report  of  all  is  the  Capability 
Analysis,  6(e).   This  analysis,  similar  to  that  described  in 
detail  under  screening,  will  permit  the  EPSDT  program  adminis- 
trator to  determine  whether  or  not  he  is  able  to  meet  diagnosis 
and  treatment  demands.   If  capability  is  not  equal  to  the  demand, 
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methods  for  increasing  capability  must  be  considered.  If,  on 
the  other  hand,  capability  is  greater  than  demand  and  is  being 
underutilized  with  demand  remaining  large,  the  administrator 
must  decide  on  alternative  service  delivery  models  that  will 
improve  the  flow  of  clients  through  his  system. 


4.3  ANALYSIS 


As  with  screening,  analyses  for  determining  demand  and  supply 
for  diagnosis  and  treatment  are  straightforward. 

D&T  Demand  Calculations 

Demand  for  D&T  should  be  considered  in  two  ways:  (1)  client 

demand  for  initial  D&T  visit  (IDDT);  and  (2)  demand  for  total 

visits  for  completion  of  D&T.  Following  are  algorithms  for 
both: 


Initial  D&T  Demand  (IDDT)  -  IDDT  =  R  -  (EDR  +  DDT  +  CDT) 

Where:  R  =  No.  of  children  with  a  positive  screen 

E  =  No.  of  children  referred  who  are  receiving  equivalent 
care 

D  =  No.  of  children  referred  who  decline  D&T  service  or 
do  not  show 

C  =  No.  of  children  referred  whose  cases  are  closed 
without  receiving  D&T  services 
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Total  Demand  for  D&T  (TDDT) 

TDDT  =  I  DDT  x  XV 
r 

Where:  XV  =  average  number  of  visits  for  D&T  that  a  referral 
will  need 

Supply  Calculation 

As  with  screening  supply,  estimation  of  provider  services  is 
dependent  on  the  provider  strategy  utilized  by  the  State.  Irres^ 
pective  of  the  strategy,  the  services  (available  provider 
stock)  must  be  defined  in  terms  of  the  number  of  providers 
available  and  by  units  of  service.  The  following  definitions 
are  therefore  offered: 

A.  Provider  Supply 

The  computation  for  facility  based  care  is  calculated  on  a 
count  of  the  number  of  facilities  offering  Medicaid  service 
according  to  the  following  categories: 

1.  General  hospitals  (proprietary  and  voluntary) 

2.  Outpatient  departments  (general  and  pediatric) 

3.  Clinics  (voluntary  and  public) 

The  computation  for  practitioners  similarly  requires  a  count 
of  practitioners  in  the  following  categories: 
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1.  Pediatricians 

2.  General  or  family  practitioners 

3.  Dentists 

4.  Pediatric  specialists 

Data  on  number  of  practitioners  located  within  an  area  can  be 
obtained  from  comprehensive  health  planning  bodies  or  medical 
societies. 

Since  there  is  less  variability  in  "unit  of  service"  capacity 
for  solo  practitioners  than  facilities,  development  of  a  ratio 
whereby  total  provider  listing  may  be  adjusted  to  reflect  the 
proportion  of  their  service  availability  to  the  EPSDT  population 
is  important. 

For  pediatricians  and  pediatric  specialists: 

Available  Provider  Stock  =  #  Practitioners  x  Medicaid  elig.  under  21 

Total  population  under  21 

For  general  or  family  practitioners  and  dentists 
(practice  not  limited  to  pediatrics): 

Available  Provider  Stock  =  #  Practitioners  x  Medicaid  elig.  under  21 

Total  population 

B.  Units  of  Service 

A  unit  of  service  is  defined  as  one  client  encounter  (e.g., 

office  visit) . 


-63- 

For  facilities  (hospitals  and  clinics)  it  is  necessary  to 

determine  first  the  facility's  capacity  in  terms  of  units  of 

service.  This  data  is  not  difficult  to  obtain.  The  Annual 

Guide  of  the  American  Hospital  Association  lists  statistics 

for  number  of  outpatient  visits  for  all  certified  hospitals 

in  the  U.S.  Breakdowns  for  pediatric  visits  can  most  probably 

be  obtained  locally  through  health  planning  organizations  or 

directly  from  the  facility.  Clinics  should  have  similar 

statistics  readily  available.  The  available  provider  stock 

for  facilities  on  a  unit  service  basis  is  then  computed  as: 

n 
Available  Provider  Stock  =  z( units  of  service)  x  Medicaid  elig.popul . 

1  Total  population 

For  practitioners,  EPSDT  planners  should  query  local  health 
planning  boards  of  medical  societies  to  obtain  estimates  of 
the  capacity  of  a  typical  provider.  These  estimates  should  be 
in  terms  of  the  four  provider  categories  (pediatricians;  general/ 
family  practice;  pediatric  specialists;  dentists).  The  computation 

for  provider  units  is  then: 

n      _ 
Available  provider  stock  =  s(nP.  •  XunitspJ  •  Medicaid  popul .  under  21 

1  i    Total  population 

J.L. 

where:  nP-  =  number  of  i   types  of  providers 

4.U 

Xunits  p.  =  average  number  of  patients  treated  by  i   type 
i   providers 
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4.4   SUMMARY 

Evaluation  of  diagnosis  and  treatment  service  delivery  depends 
upon  data  which  describes  the  relationship  between  service 
capability  and  actual  services  delivered.  The  reports  recom- 
mended for  use  provide  a  detailed  picture  of  each  element  impact- 
ing on  service  delivery.  The  data  showing  changes  over  time 
which  can  be  used  for  future  extrapolation  is  also  presented. 

The  responsibility  of  the  program  administrator  is  to  use  the 
data  to  identify  program  failure  at  a  level  of  detail  necessary 
to  illuminate  potential  solutions.  For  example,  if  D&T  demand 
is  shown  to  be  greater  than  capability,  detailed  data  describing 
total  State  service  capability  should  lead  to  planning  strategies 
for  increasing  provider  capabilities. 


CHAPTER  V:  QUALITY  ASSURANCE 
5.0  Quality  Assurance  Issues 

The  difficulties  of  assessing  "quality  of  care"  originate  in  the 
reality  that  medical,  and  especially  pediatric,  practice  combines 
elements  of  both  "art"  and  science.  Accordingly,  although  there  may 
exist  "standard"  medical  procedures  applicable  to  classified  "diagnoses," 
providers  retain  the  responsibility  and  right  to  deviate  from  these 
standards  based  upon  the  judgment  of  their  applicability  to  their 
patients. 

To  date,  researchers  attempting  to  define  "quality"  have  been  unable 
to  specify  medical  practices  into  a  scientific  logic  which  will  still 
accommodate  individual  judgments.  As  a  result,  the  current  approaches 
to  quality  assessment  rely  only  to  a  limited  extent  on  analytical 
procedures  (such  as  comparing  provider  procedures  or  prescribing 
patterns  against  "mean"  "standard  deviation"  or  other  statistics  used 
to  describe  procedures). 

The  methods  utilized  to  date  simply  support  investigations  conducted 
through  "peer  review"  models  in  which  practitioners  compare  their  own 
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"professional  judgment"  with  that  of  the  provider  in  question.  Hence, 
final  definitions  of  quality  continue  to  be  based  upon  "subjective 
processes"  whereby  providers  judge  themselves. 

As  a  result  of  this  situation,  health  program  managers  such  as  EPSDT 
program  staff  do  not  have  primary  responsibility  for  quality  assess- 
ment. Instead,  their  role  is  limited  to  accommodating  the  roles  of 
peer  review  groups. 

The  present  EPSDT  manager's  role  in  quality  assessment  suggests  the 
possible  utility  of  EPSDT  evaluation  data  in  quality  assurance.  The 
first  element  of  the  manager's  role  can  be  viewed  as  one  of  influencing 
the  peer  review  organization  by  addressing  the  body,  on  an  informed 
basis,  as  to  the  program  areas  in  whcih  quality  problems  may  lie. 
An  evaluation  system  can  be  useful  in  providing  a  general  and  pre- 
liminary identification  of  such  problem  areas. 

Subsequently,  the  manager's  role  is  to  support  the  activities  of  the 
peer  review  organization  in  its  actual  quality  investigations.  This 
role  is  largely  one  of  providing  information  which  the  program  may 
collect  that  relates  directly  to  the  quality  investigation.  Hence 
an  evaluation  system  can  only  support  such  efforts  if  it  is  designed 
to  produce  appropriate  data  (e.g.,  provider  procedure  profiles,  etc.). 
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The  use  of  evaluation  as  a  tool  in  assessing  quality  of  care  is 
therefore  limited  to  the  collection  and  organization  of  information 
which  may  suggest  quality  problems.  The  evaluation  system  should  not 
be  conceived  as  a  method  to  supplant  medical  peer  review,  but  rather 
as  a  technique  which  will  support  it. 

The  following  section  considers  evaluation  methods  which  will  aid 
in  ensuring  quality  in  screening  and  diagnosis  and  treatment. 

5.1   QUALITY  INDICATORS  IN  SCREENING 

Measuring  the  quality  of  screening  on  a  scale  as  vast  as  that 
called  for  under  EPSDT  is  difficult.  The  problems  are  compounded 
by  two  types  of  error:  first,  errors  which  are  inherent  to  the 
testing  procedures  and,  secondly,  errors  in  discrimination  with 
respect  to  the  testing  results. 

In  the  former  case,  particularly  for  lab  tests,  it  is  expected 
that  normal  quality  control  procedures  are  in  place  according 
to  whatever  requirements  are  established  by  the  State  which  may 
still  yield  some  errors.  In  the  latter  situation,  one  must  face 
errors  that  result  from  differential  interpretation  of  lab 
results.  For  example,  while  a  low  hematocrit  or  hemoglobin 
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may  suggest  anemia,  it  may  also  be  a  reflection  of  a  different, 
but  perfectly  adequate,  diet.  As  a  consequence,  screening 
findings  will  always  obtain  both  false  positive  (an  inappropriate 
indication  of  illness)  as  well  as  false  negative  (a  failure  to 
discriminate  an  ill  child)  results. 

Despite  the  problems  associated  with  the  false  positive  and 
false  negative  findings,  their  rate  of  occurrence  is  recommended 
as  the  most  reasonable  and  appropriate  method  for  judging  the 
quality  of  screening. 

The  principal  problems  in  utilizing  positive  and  negative  find- 
ings as  a  measure  of  screening  quality  are  imbedded  in  the 
measurement  definition.  In  particular,  the  measurement  of  both 
false  positives  and  false  negatives  requires  a  screening  result 
and  a  conflicting  diagnosis. 

In  the  case  of  false  positives,  it  would  appear  that  a  straight- 
forward comparison  of  the  reasons  for  referral  with  actual 
diagnosis  reveal  a  measure  of  error  or  quality.  There  is,  however, 
a  major  limitation  inherent  in  this  method.  Many  of  the  findings 
from  screening  may  be  based  on  short-term  symptoms.  So,  for 
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example,  an  inflamed  ear  seen  at  screening  may  lead  to  a  referral 
for  otitis,  yet  when  the  child  arrives  for  diagnosis  some  30  to  60 
days  later  the  inflammation  may  be  gone  and  the  child  diagnosed 
as  well.  Despite  the  limitations,  it  is  still  recommended  that 
the  rate  of  false  positives  be  used,  albeit  with  reservations, 
as  a  measure  of  screening  services  considered. 

In  the  case  of  false  negatives,  two  measurement  problems  must  be 
considered.  In  the  first  instance,  one  might  compare  the  reasons 
for  referral  with  the  actual  diagnoses  that  obtain  and  determine 
that  there  were  additional  diagnoses.  This  is  clearly  an  im- 
precise measure  as  it  is  based  upon  a  sick  child  whose  initial 
symptoms  may  have  led  to  the  referral.  However,  if  the  measure 
is  merely  used  as  an  indicator  for  a  particular  screening  provider, 
it  may  serve  to  suggest  which  ones  should  be  examined  in  greater 
detail  to  determine  whether  or  not  one  should  cite  the  provider 
and  require  improvement. 

Another  method  of  measuring  false  negatives  which  may  be  somewhat 
more  accurate  may  be  carried  out  by  those  States  who  are  able  to 
relate  episodic  treatment  to  the  date  of  screening.  In  this 
case  the  error  rate  would  result  from  comparing  a  diagnosis  which 
took  place  during  episodic  treatment  within  a  fixed  period  of 
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time  (e.g.,  30  days)  to  determine  whether  or  not  these  diagnoses 
should  have  been  made  during  screening  carried  out  within  the 
critical  time  period.  In  a  manner  similar  to  preceding  methods 
the  comparison  will  yield  an  estimate  of  false  diagnoses  of  well 
children.  With  this  indicator  in  hand,  peer  review  groups  should 
be  utilized  to  determine  whether  or  not  the  findings  are  appropri- 
ate and  whether  or  not  the  screening  provider  needs  to  improve 
his  service  capability. 

One  final  caveat  must  be  noted.  As  with  all  the  reports  that 
are  presented  in  this  document,  the  initial  and  simplest  one 
is  a  cumulative  record  of  false  positive  and  false  negative  errors 
by  a  provider—the  assumption  being  that  all  illness  has  an  actual 
probability  of  being  found  in  error  during  screening.  This 
assumption  is  not  true,  although  for  a  gross  indication  of  errors 
one  must  accept  it.  Consequently,  it  has  also  been  suggested 
that  comparisons  of  providers  should  be  made  on  the  basis  of 
errors  by  condition  as  opposed  to  cumulative  error  totals.  It 
should  again  be  noted  that  the  degree  of  sophistication  with  which 
an  EPSDT  project  manager  wishes  to  examine  these  problems  is  an 
open  decision  for  his  consideration. 
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5.2   REPORTS 

The  evaluation  of  quality  of  screening  services  is  dependent 
upon  measurement  of  errors  during  screening.  Two  types  of 
errors  occur:  false  positives  (indication  that  a  well  child  is 
ill)  and  false  negatives  (indication  that  a  sick  child  is  well). 
Measurement  of  these  types  of  errors  is  difficult.  Consequently, 
it  is  recommended  that  they  be  used  with  caution.  In  general, 
it  is  suggested  that  both  false  positives  and  false  negatives 
serve  as  indicators  of  possible  screening  service  difficulties 
which  the  EPSDT  project  manager  can  use  to  alert  appropriate 
PSRO  bodies. 

Report  Series  7  provides  methods  for  tabulating  error  data  so 
that  they  may  serve  to  differentiate  screening  service  providers. 
Report  7(a),  False  Positive  Analysis,  is  a  cumulative  total  of 
false  positive  errors  by  provider.  The  provider  is  listed  by 
rank  order  and  his  rank  order  for  the  previous  reporting  period. 
Changes  in  the  rank  order  serve  to  illuminate  possible  difficulties 
in  screening  services.  Report  7(b),  False  Negative  Analysis,  is 
interpreted  similarly  to  that  of  the  false  positive  analysis. 
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For  those  States  able  to  consider  the  problems  in  greater  depth, 
it  is  recommended  that  a  condition-by-condition  analysis  be 
undertaken  and  that  each  provider  be  ranked  on  the  basis  of  both 
false  positive  and  false  negative  errors  with  respect  to  par- 
ticular conditions.  A  demonstration  of  this  is  Report  7(c), 
Screening  Provider  Error  Profile  by  Condition.  It  is  suggested 
that  conditions  be  limited  to  the  top  five,  or  at  most  the  top 
ten  obtained  during  screening.  Considering  error  rate  by 
condition  eliminates  the  problems  of  cumulative  error  rate 
totals  which  depend  upon  the  assumption  of  equal  error  probability 
across  conditions. 


5,3   ANALYSES 


Several  methods  for  determining  error  rates  of  false  positives  and 

negatives  have  been  suggested.  In  the  case  of  false  positivies,  the 

rate  is  simply  the  number  of  times  that  screening  finding  is  not 

confirmed  by  a  diagnosis  over  the  total  screening  finding.  This  may 

be  expressed  by  the  following  equation: 

1 

ISE 
False  Positive  Rate  =  n 

T5F 

where:  SE  =  each  time  that  a  referral  is  not  confirmed  by  a.  diagnosis 
TSF  =  total  screening  findings 


-75- 


o 
c_> 

>- 

CO 

UJ 


o 

on 

Q. 

on 
O 

on 
on 


en 

o 


o 

on 

a. 

o 

2: 


on 
o 
co 


■z. 
< 
a: 

co 

< 


s- 
<v 
-a 

•r- 

> 
O 

s- 
o_ 


to 

cu 

> 

S-  J= 

•r- 

CU   4-> 

+J 

"U    c 

*o 

i~   o 

CD 

o  2: 

cu 

• 

z 

-i«£    CO 

C  -r- 

O) 

03  -C 

10 

ct:  t— 

03 


to 
<u 

> 


to 
o 

Q_ 

CD 
CO 

03 


i- 
03 
cu 

>- 


s-  x: 
cu  +-> 

•a  c 
s-  o 
o  2: 

^  +-> 
c  to 

03    03 

a:  _j 


CD 
4-> 
03 

o; 

s- 
o 

s- 

S- 


CU  +-> 

■o  c 

i-  o 

o  s: 

-i>£  -M 

C  CO 

«3  03 


0)  +■> 

■o  c 
s-  o 
o  2: 

^^  to 

C    T- 

03  -C 


01 

4-> 
03 

on 
o 

S- 

i- 


x: 

c 
o 


c 
o 


c 
o 
t_) 


^-  o 

r—  «3" 


r—  CO 


CO   «5f 


03 


cu 


00  03 

•r—  "r— 

4->  E 

■r-  CU 

+->  c 
o  <c 


c 
o 

•r— 
■*-> 

-a 
c 
o 
c_> 

JO 
CU 


o 

s- 

s- 
o 

S- 


s- 

<D 
■D 

•i- 
> 
O 

s- 

£ 

C 
CU 

cu 

s- 
u 

CO 


cu 
u 

c 

03 

s- 

CO 

to 


03 

3 

cr 

1 
1 

a 


to 
cu 

•r— 

S- 

cu 

CO 


s- 
o 

CL 

cu 
en 


-76- 


With  respect  to  false  negatives,  two  alternative  methods  have  been 
suggested.  (1)  The  number  of  additional  diagnoses  which  are  obtained 
for  a  child  being  referred  for  a  single  diagnosis  which  may  be  ex- 
pressed by  the  following  equation: 

1 
ZDS 

(1)  False  Negative  Rate  =  n_ 

TSF 

where:  DS  =  each  diagnosis  in  addition  to  that  found  at  screening 
-"     TSF  =  total  screening  findings 

(2)  The  number  of  symptoms  found  during  episodic  treatments  occurring 
within  a  fixed  time  period  subsequent  to  screening  that  should  have 
been  discovered  at  screening.  This  may  be  expressed  by  the  follow- 
ing equation: 

1 
EESft 

(2)  False  Negative  Rate  =  n 

TSF 

where:  ES  =  diagnosis  found  during  episodic  treatment  that  should 
have  been  uncovered  at  screening 

ft  =  fixed  time  period  after  screening  during  which  episodic 
treatment  data  is  obtained 

TSF  =  total  screening  findings 
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5  A      QUALITY  INDICATORS  IN  DIAGNOSIS  AND  TREATMENT 


The  problem  of  assessing  diagnosis  and  treatment  quality  is 
beyond  the  capability  of  the  EPSDT  project  manager.  It  is  recom- 
mended, therefore,  that  the  manager  work  closely  with  local 
Medicaid  Fraud  and  Abuse  Unit  and  PSRO  bodies  to  ensure  that 
providers  offering  services  to  the  eligible  population  meet 
quality  standards. 


CHAPTER  VI:  COST  AND  CLAIMS 
PAYMENTS 


6,0  Overview 


Medicaid  originated  as  a  financing  program,  hence  the  majority  of 
program  concerns  have  been  directed  to  costs  and  claims  payment. 
Moreover,  as  the  program  evolved  on  an  "open-ended  basis,"  costs  have 
escalated  to  the  point  that  Title  XIX  expenditures  have  been  cited 
as  a  principal  cause  of  the  fiscal  crisis  of  many  States  and  localities 

Given  the  fiscal  problems  of  the  States,  the  implementation  of  EPSDT 
caused  significant  concerns  in  many  States  since  its  expressed  intent 
was  to  increase  utilization  (of  primary  care),  albeit  with  the  hope 
of  later  savings  through  reduced  costs  for  chronic  or  institutional 
care.  Consequently,  implementation  of  EPSDT  was  viewed  as  a  high 
cost  item. 

As  a  result  of  the  cost  fears,  it  is  expected  that  the  State  EPSDT 
manager  (or  the  county  manager  in  States  with  a  local  Medicaid  share) 
will  most  probably  have  to: 

-accurately  estimate  costs 

-track  costs,  and 

-control  costs. 
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Conversely,  State/local  fiscal  policies  and  practices  for  Title  XIX 
generally,  or  EPSDT  specifically,  can  be  expected  to  influence  the 
status  of  EPSDT.  For  example,  fee  levels  for  screening  and  diagnosis 
and  treatment  are  a  State  policy  concern  which  could  dramatically 
affect  provider  participation,  hence  EPSDT  accomplishments.  Similarly, 
State  or  local  practices  in  claims  processing  can  have  dramatic 
(negative)  impact  if  lags  in  claims  payment  affect  provider  cash  flow 
and  thus  participation. 

6.1   COSTS 

Although  concerns  for  EPSDT  (and  Medicaid)  costs  are  universal, 
there  is  little  concensus  on  approaches  by  which  cost  information 
can  be  used  for  ensuring  sound  fiscal  policies  or  for  actually 
controlling  costs.  It  is  clear  that  widespread  application  of 
computers  to  Medicaid  claims  processing  has  often  led  to  genera- 
tion of  a  plethora  of  "cost  analyses."  It  is  less  clear  that 
there  has  uniformly  been  a  demonstrable  link  between  the  amount 
of  cost  data  now  available  and  sound  planning  and  control. 

In  an  effort  to  avoid  generation  of  data  without  demonstrable 
utility,  the  recommended  reports  have  been  designed  to  limit 
elaborate  computations  and  displays.  As  in  other  areas  of  EPSDT 
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analysis,  sophisticated  and  specific  analyses  should  only  be 
developed  on  the  basis  of  a  thorough  understanding  of  the 
problems  and  characteristics  of  unique  State  and  local  programs. 

The  reports  which  are  recommended  were  designed  to  be  supportive 
of  four  areas  of  cost  concerns.  Each  of  these  areas  may  or  may 
not  reflect  the  responsibility  of  the  EPSDT  "staff,"  as  opposed 
to  other  Medicaid  staff  units,  across  the  States.  States  or 
localities  should  review  the  reports  to  select  those  directly 
related  to  their  responsibilities.  Such  "self-selection"  will 
also  limit  the  processing  of  reports  which  do  not  have  a  clear 
relationship  to  actions  which  might  be  taken. 


6.2   REPORTS 


The  two  areas  of  concern  addressed  by  the  cost  reports  are: 
-short-term  financial  management 
-claims  management 

Short-Term  Financial  Management 

Short-term  financial  management  is  defined  in  a  limited  but 
significant  way.  Specifically,  it  is  the  responsibility  to 
track  expenditures  on  a  routine  basis  and  to  compare  expenditures 
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wi 


ith  budgets  to  anticipate  under-  and  overexpenditures.  The 
reports  provided  are  sufficient  to  track  expenditures  under  screening 
and  under  diagnosis  and  treatment  on  a  monthly  (and  cumulative) 
basis  by  county  or  State.  This  data  can  then  be  compared  with 
yearly  budgets  to  ascertain  the  proportion  of  budgeted  amounts 
spent  as  well  as  short  term  expenditure  trends. 

Report  Series  8,  Short-Term  Fiscal  Management,  has  been  designed 
to  provide  an  overview  of  cost  activity  in  screening  and  in  diagnosis 
and  treatment.  Report  8(a)  presents  monthly  screening  costs  for 
initial  and  periodic  screenings  by  age.  Report  8(b)  provides  a 
cumulative  record  of  initial  and  periodic  screening  costs. 
Report  8(c)  provides  a  method  whereby  monthly  screening  costs 
may  be  compared  with  the  State  screening  budgets  so  that  overruns 
or  cost  savings  may  be  identified. 

Report  8(d)  is  an  analysis  of  costs  for  diagnosis  and  treatment 
broken  down  by  type  of  provider;  8(e)  shows  the  same  costs  broken 
down  by  age  of  recipient.  Report  8(f)  is  a  cumulative  record 
of  D&T  costs.  Report  8(g)  allows  for  comparison  between  actual 
expenditures  and  budget. 


-82- 


o 

c: 
<u 

03 

> 

O" 

UJ 


DC 
I— 

O 


OO 

I— 
oo 

o 


UJ 
UJ 

q: 
o 
on 


I— 

UJ 
UJ 

o 


o 
on 


UJ 

l— 


O 


00 


03 
OJ 

>- 


-t-> 

c 
o 


s- 
CD 

> 
o 

S- 
Q. 

>> 

0) 

CD 

s_ 

03 


+-> 
U 

5- 


cn 
03 
5- 
OJ 

> 

c 

n3 

00 
O) 

cn- 

S-. 
03 

sz 


fO 


o 


o 


03 
O 


OJ 


-M 
O 


03 
CD 


O 


QJ 

.   s_ 

CD    03 
>  -C 


OJ 
i—   cn 

03  S- 

•4-J  03 

O  -C 

I—  O 


^_ 

oo 

03 

c 

•  i — 

<D 

CM   >—  i— 

4-> 

CD 

UD  i —  CM    03 

•r— 

i- 

1       1       1     +-> 

c 

u 

o  <o  CM   o 

1 — 1 

on 

r—    1— 

=«= 

(J 

.. 

•r- 

00 

T3 

c 

O 

O) 

Nr-r- 

•r™ 

O) 

(£>  i —  CM    03 

S- 

s_ 

1       1       1     -(-> 

cu 

u 

O  UD  CM    O 

o_ 

on 

r—  1— 

=te 

u 

.. 

^— 

•1 — 

00 

03 

-a 

c 

•r— 

o 

O) 

+-> 

•i — 

O) 

•r— 

s_ 

i- 

c 

CD 

o 

»— 4 

d. 

oo 

=tfc 

oS 

CM  i—  i— 

(T)  i —  CM    03 

I       I       I     +-> 

O  VO  CM    O 


c 
o 


CO 

o 
o 

cn 

c 

•r— 

C 

<u 

OJ 

s- 
o 
oo 


c 

QJ 
E 
CL> 

CD 
03 
C 
03 


03 
CJ 
00 


E 

i- 

ai 


s- 
o 

.c 

CO 

I 
I 

03 

CO 

00 
0) 
•r" 

i- 
OJ 
O0 

4-> 

S- 

o 

CL 
CD 


-83- 


<s> 

h- 

(S) 

o 

O  UJ 


>— I  Cd 
Z  UJ 
LU  (S) 
UJ 
Ctl  u_ 

o  o 

CO 


Q  O 

o  s: 

a:  >- 

UJ  CD 
Q_ 

O 


<  ■=£ 
1—1  _J 
I—  ^) 

I— I  21 


UJ 

o 


<S) 


C£ 

s- 

o 

m 

IE 

CD 

oo 

>- 

c 
o 


CD 

> 

•r— 

+-> 

03     ' 
r— 

13 

E 

13 

Ix 

c-c 

S- 
0) 

J3 
E 
CD 
C_> 
CD 

Q 

Ix 

w 

• 

• 

j= 
u 

Ix 

t-0 

03 

i. 
JQ 
CD 

u_ 

Ix 

K 

03 

c 

03 

Ix 

w 

INITIAL 

0-6 

6-12 
12-21 
Total 

PERIODIC 

0-6 

6-12 
12-21 
Total 

Month  Total 

Cumulative 
Year  Total 

-o 

c: 

03 


CD 

> 


03 


Z3 
C_J> 


on 

o 

CJ> 

en 

c: 

•  r- 

C 

CD 

<D 

S- 

u 

1/0 

u 

■r™ 

CD 

■o 

U 

o 

•r— 

•f— 

> 

>- 

s- 

CD 

CD 

D_ 

I/} 

"O 

4- 

c 

O 

03 

jz: 

i — 

+-> 

03 

£Z 

•  i— 

o 

+-> 

s: 

■r— 

C 

^ 

»— i 

CO 

c 
CD 
E 
CD 

CO 
03 
C 
03 


03 
U 
00 


S- 
CD 

I— 
I 

4-> 

s_ 
o 
-C 
on 
I 


J3 

00 

oo 
CD 
•t— 

i- 
CD 
OO 


S~ 
O 
CL 
<D 


-84- 


o 

LU 
Q 


Q. 
X 

UJ 


CD 
Q 


CQ 
c3 


Q 

<; 

LU 

Q 

CD 


LU 
LU 
CH 
O 
CO 


CO 


CD 


O 

en 

LU 


LU 
CD 


_J 

i- 

■=c 

<T3 

o 

Ol 

CO 

>- 

a: 


cc 
o 


to 


4-> 

c 
o 


O) 

E 

a> 
o 
a> 

Q 

• 

•r— 

Q. 

o 

^2 

(0 

=3 
S- 

a> 
u_ 

ZJ 
C 

%  Estimated 
Demand  Met 

%   Budget 
Charged 

cr. 

CQ 

+-> 
CU 


■a 

c 

A3 

E 
<U 
Q 

cr 

c: 

•r- 

C 
O) 
<U 

s_ 
o 
co 

"O 
0) 

+J 

(T3 


t/> 


o 

QJ 
CD 

4->    OJ 

c  -a 
a>  c 
u  <u 

S-     Q. 

a>  x 

D_   LU 


+J 

c 

<D 
E 
CD 
CD 
fO 

c 


fO 

a 
co 


E 
S- 

a> 

I— 

I 

+■> 

s- 
o 

-C 
CO 

I 
I 

o 

CO 
V) 

<v 

•r- 

s- 

CD 
CO 


s- 
o 

QJ 

a: 


-85- 


LU 

o 


o 


o 


>- 


00 

I— 

00 

o 


< 
LU 
(X. 

\- 

Q 
< 
OO 

M 

oo 

o 


LU 
LU 


c_> 
oo 


QC 

s- 

LU 

«3 

I— 

<D 

1 

>- 

t— 

cc 

o 

3: 

oo 

+J 

c 
o 


to 


CD 


en 
c_> 


> 


cd 


o 

s- 


x: 
o 


> 


Q 


x: 

c 
o 


<: 

4- 
O 


to 

<U 
CD 
J- 
fO  . 

J3 

C_> 


fO 
+-> 
O 


Q 


Q 


Q 


<u 

> 
O 

i~ 
Q_ 


O) 
Q. 


S- 

4-»  a> 
c  +J  c: 
cd  c  o 

■r-    a;  -r- 

4J  •!-  +-> 
f0  -M  t- 
D.  <T3   +-> 

+j  a.  u 

3    C    «3 

O  •— i    S- 

Q- 

r—  i— 

«J    (13  i— 

U-PP    (O 

•r-  •(-   •!-     i- 

c  a.  o.  a) 

•i—    to    CO    c 

r-OOD 


S- 
CD 

c 
o 


+J 

o 

03 

s- 

Q_ 

»Z 

-M    O  >> 

i—  -M  O 

fO    f0  (O 

•r-     t-  E     i- 

CJ    O  i-    CD 

a.  fo  .c  4-j 

10-JQ.O 


•    JC 
CT'O 

C_J    to 

•r— 

CO     CO 

•r-  O 
CO  C  '— ■ 
O  Cn+J 
C  «3  •<- 
OVi—  CO 
CO   Q  "l— 

•i-  > 

Q    <L) 

en  t- 

r-     (D    CU 

hi  s.  a 

+J    O) 

o   > 
i—  <c 


coo 

c_>  +-> 

c 

+->  ai 


to 


CD 

CD 

i- 

CD- 

> 


D. 


CD 

■a 

> 

o 

Q_ 

4- 
o 

CD 
Q. 

>) 


to 
+-> 
to 
o 

C_3 

+J 

c 

CD 

E 

4-> 
fO 
CD 

i- 


oC 


to 
O 

c 
en 

fO 


+-> 

c 

CD 

E 

CD 

cn 

fO 

c 

rt3 


rt3 

o 

CO 


CD 


+-> 

S- 

o 

x: 
oo 


-o 
oo 

to 
CD 

s_ 
CD 

oo 

+-> 

s- 
o 

CL 
CD 

or 


-86- 


cd 

<c 

>- 

CO 

CO 
UJ 

CD 
DC 
«=C 

:r 
c_> 

I— 


UJ 

en 


co 

co 
o 

CD 


CD 


CJ 
CO 


u_ 

*r. 

Oi 

UJ 

1— 

1 

s- 

1— 

03 

o; 

(1) 

o 

>- 

CO 


+J 

c 
o 


•r— 
00 
•r— 

> 

CD 

•feO- 

h— 

Q 

+-> 

c 

O) 

■1— 

1— 

CJ     " 

■to- 

Q 

i— 

+J 
o 
1— 

1— 

Q 

00 
+-> 

t/) 

•r- 

> 

1— 

Q 

oo 
+-> 

c 

O 

t— 

Q 

AGE 
0-6 
6-12 
12-21 

Total 

CD 
Cn 

«C 

>> 
XI 

00 

a> 
en 

S- 
03 


4-> 

C 
CD 

E 

-M 
03 
CD 


C 
A3 


00 

O 
c 
en 
03 


4-> 

c 
<D 
E 
CD 
en 
ro 
c 


03 

O 
oo 


S- 
<D 

I— 
I 

+■> 

s_ 
o 

.c 

CO 

I 
I 

cu 

00 
00 

cu 

•r— 

s- 
cu 

CO 

-M 

s- 
o 

Q. 
CD 

a: 


-87- 


o 

> 

UJ 
CO 


CQ 

CO 

H- 
OO 
O 
c_> 


I— 

< 

LjJ 


oo 

I— H 

oo 

o 

z: 


CD 


< 
O 
00 


»— 

S- 

1 

03 

J— 

0) 

o; 

>- 

o 

oo 


4-> 

c 
o 


Cumulative 
to  Date 

cu 

E 
CU 
o 
<v 

Q 

; 

x: 
u 
s- 
03 

>> 

s- 

03 

13 
S- 

-Q 
CD 

Ll. 

03 

E 

+->                                     4J 

■r-                                           •!-                                   -4-> 

•r—                                           •!—                                    t/1 

CO              >                           GO              >                  (/)•!— 

S-.           -v«                        i-           \               +->    GO     > 

CU             +->                           d)            +J                T-    +■>   **•«. 

CO  +->    00    GO                W   4J    I/)    W                (/I    1/1       ■ 

-Mccuo          +->  c  cu  o         -i-o> 

OO    C     =3    CT>(_>       h    C    3    D1U              >  O  >=t 
•— i    CU    O    t-               ^    CU    O    S- 

(/)'i-    (J    fO       •       LUt-    U    (D       •               1 —  1 —  1 — 
O  <—     C  -C     >       21   r—     £Z  -C     >               o3o3o3 

ZUUO<       1—  C_>  U_l  C_>  <t       _l  Q  O  O 

CD                     <=c                     <c 

ca;  =t»=  =tt=  OO -faO-       LU  =tte  =**=  OOOO-      I —  OOOOOO 

i— i                         cc                         o 

O                                 1—                                 1— 

U 
•r- 

> 
S- 
CU 
OO 


+J 

c 
o 


00 
CO 

o 

+J 

c 

CU 

E 

A3 

ai 

s- 
i— 

-a 

c 

03 


CO 
O 

c 

CD 


+J 

c 

CU 
E 
CU 
CD 
03 
C 
03 


03 
O 
CO 


S- 

cu 

I— 

I 
+-> 

s- 
o 

oo 
I 
I 

<+- 

00 

co 
CU 

S- 

a> 
oo 


o 

Q. 
CU 


-88- 


Q 

UJ 
D_ 
X 

UJ 


CD 
Q 

CO 


Q 


o 


o 

UJ 


00 

UJ 


cd 


c_> 
ce: 

UJ 

o_ 


UJ 


CD 


C_> 

co 


03 
CD 

>~ 


o 

n: 
co 


j= 
+j 
c 
o 


cd 

E 
CD 
O 
0) 
O 

03 

O 

1— 

1— 

Q 

• 

■ 

>> 

S- 
03 

Z3 
S- 

jd 

<D 

u_ 

03 
+-> 
O 
1— 

1— 

Q 

c 

03 

■"3 

03 
4-> 
O 

(— 

1— 

Q 

%   of  Demand  Met 
%  of  Budget  Spent 

CD 
"O 

CD 

0. 

X 

UJ 

+-> 

CD 

cr> 
T3 

CO 

oS 

4-> 
CD 


■a 
c 
03 
E 
CD 

a 


CD 


03 


+-> 
00 


CD 
CD 
03 
-M 

C 
CD 

a 

s- 

CD 

a. 


CD 

E 
CD 
cn 

03 

C 
03 


03 
U 


CD 


o 

JZ 

co 

1 
1 

a> 

00 

00 
CD 

z. 

CD 
CO 

4-> 

s- 
o 

Q. 
CD 


-89- 

6.3  CLAIMS  MANAGEMENT 

An  examination  of  a  select  number  of  State  and  local  EPSDT 
programs  indicated  that  the  lag  time  between  screening  (diagnosis 
and  treatment)  and  claims  payment  often  had  dramatic  impact  on 
provider  willingness  to  participate.  Moreover,  in  a  few  States 
the  EPSDT  program  is  authorized  to  pay  providers  directly  (as 
opposed  to  reimbursement  through  the  operating  Title  XIX  system) 
so  that  claims  lags  can  be  reduced. 

Irrespective  of  the  organizational  arrangements  for  claims 
processing,  it  appears  that  knowledge  of  claims  turnaround  is 
vital  for  an  understanding  of  provider  participation  incentives. 
Moreover,  identification  of  the  extent  of  outstanding  claims  may 
be  important  for  an  identification  of  true  program  costs, 
anticipation  of  upcoming  fiscal  demands  (e.g.,  high  volume  of 
claims  submission  after  tax  year  end  from  solo  providers). 
Hence  reports  are  provided  which  examine  claims  turnaround  for 
screening  and  for  diagnosis  and  treatment. 

6.4  REPORTS 

Report  Series  9,  Claims  Management,  identifies  the  extent  of 
claims  processed  by  screening  and  by  diagnosis  and  treatment. 
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Report  9(a)  identifies  the  time  between  the  screening  encounter 

and  the  screening  claim  as  well  as  the  number  of  days  between  claim  and 

payment.  Report  9(b)  provides  the  same  data  for  diagnosis  and 

treatment.  Reports  9(c)  and  (d)  record  errors  and 

adjustments  on  a  monthly  and  cumulative  basis  respectively. 

These  latter  tables  can  be  used  to  identify  providers  having 

the  greatest  difficulty  in  meeting  claims  requirements. 
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CHAPTER  VII:  LONG-RANGE 
PLANNING 


7,0    Overview 


The  preceding  chapters  have  provided  a  structural  model  for  evaluation 
and  short-term  planning.   The  model  permits  program  adminis- 
trators to  examine  program  status,  determine  difficulties,  and  plan 
strategies  for  improvement.  Essentially  this  model  is  reactive  in 
design  in  that  changes  or  failures  in  the  program  serve  as  stimuli  for 
immediate  planning  for  improvement. 

Effective  short-term  improvement,  however,  is  not  the  only  role  of 
the  program  administrator.  Long-term  concerns  vis-a-vis  supply  and 
demand  and  their  cost  are  crucial  to  the  EPSDT  project  manager.  The 
manager's  role  in  long-term  planning  is  to  develop  methods  for  estimat- 
ing supply  and  demand  and  their  associated  costs,  and  developing 
strategies  which  will  yield  the  best  solution  for  obtaining  program 
success  within  the  constraints  of  the  State  budget.  For  example,  the 
program  administrator  might  develop  methods  for  estimating  demand  and 
supply  for  EPSDT  for  a  five-year  period.  These  estimates  may 
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indicate  increasing  costs  far  beyond  that  allowed  by  State  finance 
and  budget  projections.  Consequently,  strategies  may  have  to  be 
developed  which  will  reduce  costs  either  through  improvement  of 
efficiency  (e.g.,  consolidation  of  fragmentary  screening  services) 
or  through  decreases  in  services  (e.g.,  increasing  the  duration  of 
periodicity  schedule)  which  will  permit  the  program  to  operate  within 
State  budgetary  and  policy  constraints. 

Parenthetically,  it  should  be  noted  that  these  policy  and  budgetary 
constraints  are  a  function  of  the  political  atmosphere  and  may  change 
in  unanticipated, albeit  dramatic,  fashion  from  year  to  year.  The 
question  is  not  whether  long-range  planning  is  defeated  by  such 
political  events  but  whether  or  not  long-range  planning  may  be 
carried  out  in  a  fashion  which  accommodates  such  changes. 

In  this  section,  a  series  of  algorithms  are  developed  which  furnish 
the  program  administrator  with  methods  for  estimating  both  supply 
and  demand.  These  algorithms  may  be  used  to  consider  various  alterna- 
tive strategies  for  service  delivery,  increase  of  provider  capability, 
etc.,  under  various  budgetary  parameters. 
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7,1   LONG-RANGE  PLANNING  ESTIMATES 

Long-range  planning  for  EPSDT  requires  the  development  of 
methods  for  estimating: 

-client  demand  for  screening,  diagnosis  and  treatment 

-program  capacity 

-program  costs 

Estimating  supply,  demand,  and  costs  is  made  difficult  by  inter- 
relationships of  various  elements  which  affect  supply  and  demand 
In  particular,  the  following  must  be  considered: 

The  Relationship  Between  EPSDT  Service  Delivery  Factors 

The  demand  for  EPSDT  services  is  a  function  of  all  facets  of 
program  operations  including  supply,  since  the  total  demand  is 
a  function  of  screening  demand  (both  initial  and  periodic), 
screening  results  (i.e.,  referrals),  and  the  average  number  of 
visits  for  completion  of  diagnosis  and  treatment.  Since  all  of 
the  preceding  are  a  function  of  the  capacity  of  local  providers 
(i.e.,  provider  availability  of  services  for  the  Medicaid 
population),  simple  projections  of  total  eligibles  cannot 
serve  to  predict  demand. 
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Voluntary  Client  Participation 

Much  concern  has  been  evidenced  at  the  disparity  between  the 
number  of  eligibles  and  the  number  of  children  having  received 
EPSDT  services.  Many  factors,  however,  influence  this  dis- 
parity. In  particular,  turnover,  equivalence,  and  declines 
(i.e.,  either  on  the  basis  of  an  actual  decline  of  service  or 
on  the  basis  of  failure  to  meet  scheduled  appointments)  are 
most  probably  responsible  for  a  large  proportion  of  the  disparity. 
It  is  important,  therefore,  that  these  be  taken  into  clear  account 
in  estimating  demand  lest  long-range  projections  result  in 
serious  overestimates. 

Measurement  of  Provider  Capacity 

The  difficulties  in  defining  and  measuring  provider  capacity 
have  been  discussed  in  Chapters  II  and  III.  Suffice  to  say  that 
there  are  no  reliable  methods  for  analytically  estimating  capacity 

A  measure  of  capacity,  however,  becomes  critical  in  any  long- 
range  planning.  Consequently  the  program  administrator  must 
undertake  to  develop  a  rational  basis  for  estimating  expected 
provider  services. 


„99- 

Estimating  demand,  capability,  and  program  performance 
involves  the  use  of  a  series  of  algorithms  designed  to  address 
EPSDT  planning  needs.  These  algorithms  represent  all  facets 
which  affect  both  demand  and  supply. 

Essentially,  the  algorithms  allow  one  to  begin  with  initial 
demand  (i.e.,  the  number  of  eligibles  awaiting  initial  and 
periodic  screening  and  diagnosis  and  treatment).  Subsequently 
they  allow  for  estimates  of  annual  demand  generated 
during  the  year  from  new  case  openings  and  the  progress  of 
clients  through  EPSDT.  The  algorithms  also  allow  for  appropri- 
ate discounting  based  on  turnover,  equivalence,  and  declines 
so  that  the  final  estimate  for  each  year  is  a  reasonable  picture 
of  the  demand  for  that  period. 

When  the  demand  estimates  are  obtained,  cost  factors  can  be 
utilized  and  estimates  for  cost  of  meeting  the  demand  obtained. 
In  addition  comparison  between  demand  and  supply  (i.e.,  provider 
availability)  may  also  be  carried  out.  Subsequently,  one  may 
use  these  algorithms  to  formulate  various  possibilities  to 
determine  service  strategies  which  will  yield  the  most  success- 
ful programs  at  the  most  reasonable  cost. 
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7.2   ALGORITHMS  FOR  ESTIMATING  SUPPLY  AND  DEMAND 

In  this  section  algorithms  for  estimating  supply  and  demand, 
for  screening, and  for  diagnosis  and  treatment  are  presented. 
To  facilitate  their  use  a  series  of  sample  calculations 
utilizing  the  algorithms  have  been  prepared  and  are  presented 
in  Appendix  A. 

A.  Screening  Demand 

Total  Screening  Demand  =  Initial  Scr.  Demand  +  Periodic  Scr.  Demand 

[1]  TSD  =  ISD  +  PSD 

This  is  obtained  as  follows: 

[la]  ISD  =  Adjusted  No.  of  Unscreened  eligibles  +  Adjusted  No. 
Case  Openings 

or  ISD  =  AUE  +  ACO 

with:  AUE  =  No.  of  Unscreened  eligibles  x  Adjustment  factors 

n 

or  AUE  =  ZUE  •  [1.0  -  er  +  dr  +  cr  ] 
,     L       u    u    uJ 

where:  UE  =  unscreened  eligibles 

.  .      .     #  Eligibles  receiving  equivalent  service 
er  =  equivalence  rate  or  Tota1%1igib1e a-a 

dr  =  decline  rate  or  *   ^9^3  who  decline 

Total  eligible 

cr  =  closing  rate  or  #  Eligibles  whose  cases  are  closed  unscreened 

Total  eligible 
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and:  ACO  -  No.  client  openings  x  Adjustment  factors 

or   AC0  =  ECO  x  [1.0  -  er  -  dr  -  crl 
,     L       c     c     CJ 

where:  CO  =  new  case  openings. 

[lb]  PSD  =  No.  of  Periodic  Eligibles  x  Adjustment  factors  x  Periodicity 

rate 

or   PSD  = 

0    iU   ZPE  x  [1.0  -  er  -  dr  -  cr  ]  x  PR 
1     L       P    P    P 

where:  PR  =  No.  of  times  recipient  is  rescreened  each  year. 


B.  Screening  Capacity 

Screening  Capacity  =  Total  No. Providers  •  Avg.  No.  units  Available 

for  EPSDT  screening 

n 
or:  [2]  SC  ='  zP,  •  [XU1 

1  1     s 

where:  P.  =  Each  provider  contracted  to  offer  EPSDT  screening 

XII     =  Mean  screening  service  units  available. 

s  3 

A  detailed  discussion  of  methods  for  obtaining  estimates  of 
number  of  providers  and  the  units  of  service  they  provide  is 
presented  in  Chapter  III,  Section  3.3. 


C.  Estimated  Screening  Performance 


Estimated  Screening  Performance  =  Screening  Capacity 

Total  Screeninn  Demand 
or  [3]  ESP  =  S^_ 
TSD 
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D.  Diagnosis  and  Treatment  Demand 

Total  Demand  for  D&T  =  Initial  Demand  for  D&T  x  Average  Visits 

per  referral . 

or  [4]  TDDT  =  I DDT  x  XV 

This  is  obtained  as  follows: 

[4a]  IDDT  =  ESP*  ■  RR  •  (1.0  -  erDT  -  drQT  -  crDT) 

where:  RR  =  referral  rate  from  screening,  or  #  Referrals  from  screen 

Total  #  Screened 

erDT  =  equivalence  rate 

drQT  =  decline  rate 

crDT  =  rate  of  untreated  case  closings 


E.  Diagnosis  and  Treatment  Capacity 

Diagnosis  and  Treatment  Capacity  =  Total  Providers  x  Avg.  #  Units 

Available  for  EPSDT  D&T 
n 
or:  [5]  DTC  =  EPi  '(XU^) 

where:  P.  =  Each  provider  contracted  to  offer  EPSDT  diagnosis 
and  treatment  services 

XllDT  =  Mean  medical  service  units  available  for  EPSDT 
referred  Diagnosis  and  Treatment 

A  detailed  discussion  of  methods  for  obtaining  estimates  of  the 

number  of  providers  and  units  of  service  they  may  provide  for 

diagnosis  and  treatment  for  EPSDT  referrals  is  presented  in 

Chapter  IV,  Section  4.3. 


rNote  Equation  [3] 
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F.  Estimated  D&T  Performance 

Estimated  Diagnosis  &  Treatment  Performance  =  D&T  Capacity 

Total  demand  for  D&T 

or  [6]  EDTP  =  PTC 
TDDT 

The  algorithms  permit  one  to  determine  annual  figures  for 
supply  and  demand.  To  use  these  algorithms  for  projections 
greater  than  one  year  requires  the  development  of  a  set  of 
inflators  or  deflators  which  reflect  the  growth  or  decline  of 
new  case  openings,  or  particular  State  policies  which  may 
be  designed  to  affect  case  openings. 

The  algorithms  also  permit  the  program  manager  to  model  various 
mixes  to  determine  requirements  so  that  supply  and  demand  solu- 
tions may  be  obtained.  For  example,  one  way  of  reducing  demand 
is  to  increase  the  periodicity  rate.  If  one  holds  both  provider 
capability  and  new  case  openings  constant  one  may  determine 
the  appropriate  periodicity  rate. 

7.3   COST  ESTIMATING 

To  this  point  we  have  presented  a  series  of  algorithms  which 
will  allow  for  the  determination  of  screening  and  diagnosis 
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and  treatment  demand, as  well  as  for  provider  capability.  We 
have  treated  the  supply  and  demand  problems  independent  of 
costs  to  demonstrate  ways  in  which  the  program  manager  may 
estimate  his  needs  or  determine  optimal  strategies  so  that  pro- 
gram performance  meets  the  predicted  needs  of  the  recipient 
population.  Clearly  these  strategies  will  not  be  independent 
of  financial  constraints  imposed  by  State  budgets  for  health 
care  which  will  most  probably  be  the  deciding  factor  in 
developing  strategies  for  long-term  program  planning. 

Determining  the  costs  of  EPSDT  services  requires  that  the 

algorithms  for  screening  performance  and  D&T  performance  be 

multiplied  by  the  average  cost  for  services  in  the  following 

way: 

Cost  of  Screening  =  TSD  x  X"  Screening  Cost 

Cost  of  D&T  =  TDDT  •  X  D&T  cost  of  completed  treatment 

Cost  of  services  can  be  obtained  by  obtaining  average  data  for 
costs  of  screening  and  D&T.  It  should  be  noted,  however,  that 
this  analysis  is  performed  in  terms  of  present  dollars  and 
does  not  reflect  inflationary  or  deflationary  trends  in  the 
economy.  Clearly,  these  factors  must  be  considered.  Methods 


-105- 

are  available  for  estimating  changes  in  the  economy  (e.g., 
extrapolating  consumer  price  index  trends  to  determine  these 
factors) . 

State  budgetary  constraints  imposed  by  legislative  budget 
committees  may  provide  budgetary  limits  for  medical  costs 
for  future  years.  In  this  case  the  program  manager  must  use 
these  figures  as  constraints  and  begin  to  use  the  algorithms 
to  determine  solutions  which  will  allow  him  to  optimize  program 
performance. 

For  those  States  having  sophisticated  technical  personnel  more 
detailed  specifications  of  costs  may  be  determined  by  breaking 
down  costs  of  both  screening  and  D&T  demand  by  age  utilization. 
As  trends  in  birth  rate  change  these  can  then  be  used  to  adjust 
cost  estimates  resulting  in  more  reliable  prediction  of  program 
costs. 


CHAPTER  VIII:  IMPLEMENTATION 


8.0  Overview 


Investigation  of  the  status  of  EPSDT  implementation  demonstrated 
widespread  differences  in  program  administration  and  structure  between 
the  States.  These  differences  were  reflected  in  the  degree  of 
variation  evidenced  in  comparing  the  information  systems  which 
supported  State  and  local  efforts  (e.g.,  no  two  State  systems  were 
designed  around  equivalent  data  elements  or  file  update  schedules 
and  procedures) . 

Even  more  significant  was  the  finding  that  there  were  widespread 
variations  at  the  level  of  general  systems  designs.  Hence  "basic" 
files  found  in  one  State  (e.g.,  automated  provider  file)  did  not 
exist  in  others.  And  while  certain  States  operated  comprehensive 
centralized  systems  (e.g.,  including  eligibility,  claims  processing, 
and  EPSDT),  many  States  operated  a  number  of  parallel  systems,  often 
through  different  organizations  (e.g.,  eligibility  through  income 
maintenance,  claims  processing  at  a  local  level,  and  EPSDT  screening 
centrally) . 
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Consequently,  it  was  concluded  that  assumptions  underlying  development 
of  the  evaluation  system  which  mandated  a  highly  specific  systems 
design  approach  would  require  massive  efforts  and  extensive  dollar 
outlays  on  the  part  of  both  the  States  and  the  Federal  government. 
Such  an  approach  would  have  involved  exacting  prescriptions  of  eyery 
data  element  States  and  localities  should  collect,  file  structures, 
update  procedures,  software  strategies,  etc. 

Given  the  variability  of  States'  data  systems,  mandating  a  unitary 
approach  would  have  resulted  in  frustration  on  the  part  of  States 
since  it  would  have  forced  most  States  and  localities  to  abandon 

existing  systems  which  have  often  developed  to  meet  State  and  local 

4 
priorities  and  constraints  of  a  very  real  nature. 

As  part  of  this  effort, evaluation  and  system  designs  attempted  in 
other  pediatric  health  programs  (e.g.,  Children  and  Youth)  were 
investigated.  These  efforts  were  most  often  found  to  have  ended 
in  failure  based  upon  attempts  by  their  designers  to  mandate  highly 
specific  technologies  on  diverse  local  programs. 


4.  The  tedious  history  of  MMIS  implementation  lends  support  to 
this  conclusion. 
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Hence  the  State/local  evaluation  system  has  been  designed  in  a  manner 
which  will  permit  a  more  flexible  State  and  local  approach  to  imple- 
mentation. Rather  than  mandating  an  exacting  and  comprehensive  revision 
of  existing  data  systems,  the  evaluation  system  is  defined  by  a  set  of 
"output  reports."  These  output  reports  can  be  generated  if  minimal 
data  sets  are  available  in  the  State  Medicaid  and  EPSDT  systems.  Moreover, 
information  required  to  prepare  the  "output  reports"  do  not  necessitate 
precise  data  points,  specific  definitions,  or  record  flow  requirements.  On  the 
contrary,  existing  files  can  most  probably  be  utilized  if  the  data 
currently  collected  falls  within  broad  "data  classifications"  upon  which 
the  output  reports  are  based. 

To  demonstrate  the  feasibility  of  this  approach,  the  model  was  imple- 
mented in  a  single  State  with  singular  success  and,  most  importantly, 
at  irinimal  costs.  A  detailed  description  of  the  in-place  system  and 
the  history  of  its  development  is  presented  in  Appendix  B.  Based  upon 
this  experience,  a  general  model  for  implementation  was  evolved.  The 
following  sections  detail  recommended  implementation  strategies. 

8.1   IMPLEMENTATION  TASKS 

This  section  presents  an  outline  for  a  general  work  plan  for 
States  wishing  to  upgrade  their  data  systems  to  produce  relevant 
evaluation  and  planning  reports. 
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Before  describing  the  implementation  process,  it  is  necessary 
to  review  the  implications  of  the  model  for  States  which  operate 
EPSDT  on  a  highly  centralized  basis  versus  those  which  "super- 
vise" unique  EPSDT  programs  managed  at  the  local  (e.g.,  county) 
level . 

An  example  of  a  highly  centralized  State  is  South  Carolina. 
There,  EPSDT  operational  functions  are  replicated  in  like  fashion 
in  each  county.  The  State  Department  of  Public  Health  provides 
screening  services.  These  efforts  are  supported  by  State  Social 
Service  staff  who  are  responsible  for  notifying  and  scheduling 
recipients  for  screening.  Diagnosis  and  treatment  is  provided  by 
regular  Medicaid  providers.  All  operations  are  supported  by  a 
centralized  information  system  relying  upon  common  input  from 
each  county. 

At  the  other  extreme,  New  York  State  operates  its  EPSDT  program 
(CHAP)  on  a  decentralized  basis.  Similarly  to  the  administration 
of  its  Public  Assistance  program,  New  York  has  delegated  to  each 
county  the  responsibility  for  developing  CHAP  implementation 
strategies  geared  to  local  needs.  As  a  result,  EPSDT  functional 
activities  vary  from  county  to  county  as  do  EPSDT  and  related 
data  systems. 
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In  States  such  as  New  York  the  basis  for  planning  for  a  feasible 
evaluation  system  for  EPSDT  must  be  the  local  project.  Each 
local  project  must  be  analyzed  to  develop  a  system  supportive  of 
its  activities  which  maximizes  utilization  of  the  varying  current 
data  collection  efforts  in  place.  That  is,  the  State  must  apply 
the  "data  classification"  strategy  to  each  local  project  in  turn. 
The  necessity  for  this  approach  cannot  be  overstated.  Just  as 
it  is  not  feasible  for  the  Federal  level  to  dictate  exacting 
EPSDT  system  designs  upon  States,  it  is  not  feasible  for  States 
which  have  permitted  counties  to  develop  unique  EPSDT  programs 
(and  related  data  systems)  to  mandate  specific  county  systems  for 
EPSDT.  Unitary  approaches  will  only  be  feasible  if  the  State  is 
simultaneously  prepared  to  exact  correspondence  in  income  main- 
tenance, Medicaid  systems,  and  administrative  and  service  delivery 
procedures. 

On  the  other  hand,  highly  centralized  States  such  as  South 
Carolina  operate  as  local  projects  with  direct  responsibility 
flowing  from  the  State  capital  to  State  employees  performing  common 
activities  in  localities.  While  such  States  must  be  careful  to 
reflect  service  delivery  needs  in  developing  a  model  implementa- 
tion plan,  they  will  typically  find  that  their  system  can  be  based 
upon  the  concept  of  common  input  from  local  projects. 
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The  following  section  describing  implementation  task  is  presented 
in  terms  of  "State"  functions.  The  reader  concerned  with  local 
projects  or  with  a  State  operating  on  a  decentralized  basis  should 
recognize  the  need  to  tailor  planning  activities  to  fully  reflect 
local  project  variability. 

Task  I:  Identification  of  Planning  Resources 

Upon  deciding  to  consider  model  implementation,  the  State  must 

identify  and  allocate  resources  for  the  planning  effort.  The 

primary  resource  for  implementation  analysis  and  planning  is 
program  and  technical  staff: 

Program  Staff 

The  model  is  based  upon  a  classification  of  common  State  EPSDT 
activities  but  does  not  reflect  the  specifics  of  individual 
State  strategies  or  their  priorities.  Staff  with  experience  suf- 
ficient to  reflect  specific  service  delivery  and  the  full  range 
of  management  concerns  must  be  made  available  during  the  first 
phase  of  model  development  so  that  clear  definition  of  planning 
and  evaluation  issues  can  be  obtained. 

Technical  Staff 

Staff  currently  responsible  for  development  or  operation  of 

information  systems  which  might  be  utilized  in  the  EPSDT  design 


-112- 


must  be  identified.  Managers  of  computing  facilities  should 
be  involved  to  identify  the  overall  constraints  on  new  systems 
development  into  which  EPSDT  activities  must  fit.  Systems 
analysts  or  programmers  will  be  required  who  can  identify  the 
specific  capabilities  of  current  systems  as  well  as  implement 
the  evaluation  design  once  developed.  Since-  State  computer 
processing  staff  often  share  diverse  responsibilities,  it  may 
be  wise  to  assign  a  programmer/analyst  to  the  model  effort 
full  time  to  preserve  continuity  and  assure  rapid  turnaround. 
Technical  staff  should  also  include  personnel  with  expertise  in 
evaluation,  planning,  or  data  analysis.  These  staff  would  be 
responsible  for  addressing  the  feasibility  and  desirability  of 
analytical  approaches  relevant  to  the  model  (e.g.,  the  level  of 
sophistication  and  detail  to  be  attempted  in  long-range  planning 
for  EPSDT). 

Consultants 

Technical  consultants  may  be  utilized  as  required  in  planning 
or  in  providing  specific  technical  assistance  (such  as  data 
analysis  development)  to  support  State  efforts.  The  State  should 
not  take  the  position,  however,  that  consultants  can  substitute 
for  the  input  of  service  deliverers  or  managers  in  identifying 
program  issues  and  their  priorities  or  that  they  can  identify 
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the  potential  use  of  current  data  systems  without  significant 
input  from  data  processing  personnel. 

Task  II;  Definition  of  Planning  and  Evaluation  Requirements 

a.  Identify  Planning  Commitee 

A  representative  knowledgable  group  of  service  deliverers  and  EPSDT 
managers  should  be  identified  from  the  resource  group  to  guide  the 
definition  of  planning  and  evaluation  needs. 

b.  Assemble  Planning  Committee  and  Develop  Work  Plan  for  Definition 
of  Planning  and  Evaluation  Needs 

c.  Conduct  Analysis  of  Planning  and  Evaluation  Needs  and  Model 
Priorities 

The  purpose  of  these  tasks  is  to  review  the  evaluation  and  planning 
approaches  recommended  in  the  model  to  select  those  most  relevant 
(and  feasible)  for  the  State.  This  is  by  far  the  most  critical  tack 
in  implementing  the  planning  and  evaluation  model.  The  primary 
responsibility  for  this  task  should  be  lodged  with  program  staff 
since  they  are  the  ones  who  can  best  identify  the  evaluation  reports 
and  reporting  techniques  useful  for  the  management  of  EPSDT. 
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A  specific  blueprint  for  selection  of  the  evaluation  reports  and 
information  useful  for  management  cannot  be  provided.  The  discussion 
of  evaluation  and  planning  issues  throughout  this  document  has  been 
designed  to  identify  the  rationale  for  each  report.  A  review  of 
these  discussions  may  be  an  appropriate  first  step  in  design  of 
the  State  evaluation  system.  Beyond  this  step  management  staff 
must  exercise  their  own  judgment  in  defining  evaluation  and  planning 
needs. 

Two  common  errors  in  development  of  information  systems  should  be 
noted  and  avoided.  The  first  is  selection  of  output  reports  which 
appear  "interesting,"  but  which  have  no  relationship  to  action  on 
the  part  of  managers  or  planners.  Failure  to  limit  reporting  and 
analysis  to  "action  related"  information  is  a  key  cause  for  voluminous 
reports  which  quickly  become  viewed  by  staff  as  irrelevant  to  their 
responsibilities. 

A  second  and  common  error  occurs  when  managers  and  planners  attempt  to 
develop  the  ultimate  solution  for  planning  and  evaluating  social 
programs.  Such  attempts  fail  to  recognize  the  need  for  structure 
and  typically  attempt  to  measure  everything.  These  attempts  also 
lead  to  costly  systems  upgrading  or  modification  and  volumes  of 
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irrelevant  data. 

The  evaluation  reports  described  in  this  document  have  been  purposely 
designed  to  address  the  most  general  information  needs  in  EPSDT. 
Subsequently,  additional  reports  are  provided  which  permit  more 
detailed  analyses.  States  may  be  wise  to  consider  a  phased  imple- 
mentation in  which  the  more  detailed  or  sophisticated  analyses  are 
considered  on  the  basis  of  experience  with  less  sophisticated 
approaches. 

Given  these  suggestions,  it  is  recommended  that  a  review  of  the 
recommended  evaluation  reports  is  prepared  within  the  framework 
of  the  following  questions; 

1.  Who  will  use  this  information? 

2.  What  actions  will  follow  given  availability  of  the  informa- 
tion? 

3.  How  frequently  is  this  information  needed? 

This  document  should  be  prepared  for  wide  circulation  among  EPSDT 
and  Medicaid  staff  (including  related  staff  such  as  PSRO)  for  comment. 
Negotiations  among  various  personnel  with  differing  viewpoints  should 
lead  to  a  final  draft  which  identifies  in  detail  reports  and  analyses 
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for  further  consideration. 

Task  III;  Feasibility  Analysis—Classification  of  Existing  Data  vs 
Data  Classes  Required  for  Evaluation  and  Planning  Reports 

The  output  of  task  II  will  be  a  listing  and  description  of  use 
of  relevant  evaluation  and  planning  reports.  Subsequently,  task 
III  involves  a  comparison  of  the  data  classifications  contained 
in  each  output  report  against  specific  data  elements  maintained 
at  that  time  in  the  State's  EPSDT  and  related  data  systems  (e.g., 
income  maintenance,  Medicaid  claims  processing,  etc.)  to  determine 
the  feasibility  of  utilizing  existing  data  sets.  Task  III  should 
be  conducted  by  the  State's  computer  and  data  systems  specialists 
(or  consultants)  for  whom  such  analyses  are  routine.  For  each 
classification  of  data  the  following  determinations  should  be 
made: 

a.  The  information  need  is  currently  met  in  terms  of  data 
conveniently  stored  in  EPSDT  related  files. 

b.  The  information  need  can  be  met  by  converting  existing 
related  data.  For  example,  screening  outcomes  (suspected 
diagnosis)  may  be  in  ICDA  while  D&T  claims  utilize  a 
third  party  designate  coding  system  (e.g.,  Blue  Cross 
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payment  codes).  A  conversion  program  could  be  mounted  between  ICDA 
and  the  third  party  designate  codes  at  less  effort  than  modifying 
forms  and  current  local  reporting  to  one  code  or  the  other. 

c.  The  information  need  can  not  be  met  either  by  existing  data 
or  by  data  conversion. 

d.  Files  are  updated  on  a  schedule  such  that  data  under  a 
classification  will  (will  not)  be  current  in  terms  of  the 
periodicity  of  reporting  deemed  necessary. 

Once  these  four  determinations  are  made,  computer  analysts  can  then 
develop  a  specific  plan  identifying  the  programming  and/or  file 
modifications  which  would  be  required  to  output  the  necessary 
reports.  This  plan  should  consist  of  the  following: 

1.  Definition  of  output  reports. 

2.  Flow  chart  which  relates  EPSDT  activities  to  EPSDT  records 
and  computer  processing  (e.g.,  file  generation  and  mainten- 
ance) necessary  to  output  EPSDT  evaluation  and  planning 
reports. 

3.  A  definition  and  schedule  of  tasks  for  systems  upgrading. 

4.  Estimated  costs. 
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This  report  should  be  reviewed  by  EPSDT  program  managers  to  assess 
the  feasibility  of  implementing  components  of  the  evaluation  system 
selected  under  Task  II.  This  review  should  lead  to  a  final  plan  for 
implementation  of  the  evaluation  model. 


APPENDIX  A 


Sample  Planning  Calculations 


SAMPLE  CALCULATIONS 

DEMAND  FOR  SCREENING 

Total  Demand  is  the  sum  of  Initial  Screening  Demand  (ISD)  and 
Periodic  Screening  Demand  (PSD),  where  both  ISD  and  PSD  are 
adjusted  for  case  closing,  declines,  etc. 
(1)  TSD  -  ISD  +  PSD 

A.  Estimating  Initial  Screening  Demand 
Initial  Screening  Demand  (ISD)  is  the  sum  of  the  number  of 
adjusted  unscreened  eligibles  (AUE)  and  the  adjusted  number  of 
new  client  case  openings  (ACCO). 
(la)  ISD  =  AUE  +  ACCO 

Let  us  assume  for  this  example  that  the  number  of  unscreened 
eligibles  (#UE)  at  the  beginning  of  the  planning  period  is 
10,000  children. 

Adjustments  are  carried  out  by  discounting  the  number  of  un- 
screened eligibles  by  those  who  are  receiving  equivalent  care  (er), 
by  declines  (dr),  and  by  those  cases  closed  which  have  not  received 
screenings  (cr). 

therefore,  AUE  =  #UE  x  (1.0  -  eru  -  dru  -  cru) 
The  analyst  has  several  options  for  developing  these  discount 
rates.  First,  he  may  examine  past  performance  and  use  the  average 


rates  for  the  preceding  year.  Second,  the  analyst  may  use 
recent  trends  to  extrapolate  the  rates  for  the  upcoming  year. 
Third,  he  may  extrapolate  from  recent  trends  and  adjust  the 
rates  on  the  basis  of  anticipated  program  or  policy  changes.* 

In  addition  to  the  adjusted  number  of  unscreened  eligibles 
(AUE)  it  is  necessary  to  estimate  the  adjusted  number  of  clients 
who  will  be  entering  the  program  for  the  first  time  (ACCO).  This 
calculation  raises  an  analytical  issue  broader  than  EPSDT 
planning:  specifically,  estimating  new  eligibles  under  EPSDT 
is  part  of  the  larger  question  of  predicting  increases  (or 
decreases)  in  caseloads  for  income  maintenance  programs  to  which 
Medicaid  eligibility  is  equivalent  or  at  least  closely  tied. 

There  are  a  number  of  basic  approaches  which  can  be  utilized  to 
predict  caseload  trends.  In  many  States,  the  income  maintenance 
unit  is  responsible  for  predicting  caseload  trends  and  these 
trends  can  be  utilized  by  the  EPSDT  analyst.  The  simple  averaging 


*For  the  analyst  with  sufficient  resources  and  a  rich  data  base, 
a  more  dynamic  approach  may  be  used.  The  analyst  may  be  able 
to  develop  a  simulation  model  to  determine  the  ratios  which 
would  not  only  reflect  the  multiple  variables  involved,  such 
as  the  distribution  of  age  in  the  population,  current  length 
of  stay,  etc.,  but  also  lead  to  optimal  strategies  (e.g., 
using  current  length  of  stay  as  a  predictor  of  closing  rate). 


of  historical  data  or  projecting  trends  with  time  series 
techniques  might  also  be  used.  These  methods,  however,  do  not 
account  for  the  impact  of  changes  in  the  local  economy  or  pro- 
gram policy  modifications  which  may  occur.*  Hence  predictors 
which  reflect  potential  changes  in  the  economy  or  in  State  policy 
must  be  determined. 

In  the  present  example,  we  will  assume  that  client  case  openings 
(#CC0)  during  the  upcoming  year  will  account  for  2,000  new 
eligibles  for  initial  EPSDT  screening.  Adjusting  for  er,  dr, 

and  cr  using  last  year's  averaged  rates,  the  following  is  obtained 

n 

ACCO  =  ECO  x  (1.0  -  er  -  dr  -  cr  ) 
1  c    c    c 

ACCO  =  2000  x  (1.0  -  .05  -  .20  -  .10) 

ACCO  =  1300 

By  combining  the  adjusted  number  of  unscreened  eligibles  (AUE)  and 

the  adjusted  number  of  client  case  openings  (ACCO),  we  can  compute 

Initial  Screening  Demand  (ISD) 

(la)  ISD  =  AUE  +  ACCO 
ISD  =  6500  +  1300 
ISD  =  7800 


*There  are  econometric  and  probability  models  which  attempt  to 
explicitly  identify  and  predict  those  factors  which  underly 
caseload  growth  and  growth  trends.  One  such  model  is  the 
"general  relief"  model  used  in  the  State  of  Massachusetts  which 
predicts  caseload  as  a  function  of  employment  in  the  industrial 
sector  of  the  State's  economy. 


B.  Estimating  Periodic  Screening  Demand 

Periodic  Screening  Demand  (PSD)  is  a  function  of  the  adjusted 

number  of  periodic  eligibles  (APE)  and  the  periodicity  rate  per 

year. 

n 
(lb)  PSD  =  ePE  x  Adjustment  Factors  x  Periodicity  Rate 

Estimating  the  number  of  clients,  who  will  require  a  periodic 

screen  during  the  upcoming  year  can  be  complex  depending  upon  the 

periodicity  schedule,  the  status  of  the  population,  and  the 

degree  of  precision  sought. 

The  status  of  the  population  will  affect  demand  for  periodic 
screening  if  there  is  a  "backlog"  of  clients  at  the  beginning  of 
the  year  who  require  a  periodic  screen.  Also,  during  the  year 
addition  clients  may  become  eligible  who  have  completed  an  initial 
screen  previously.  "Previously"  will  refer  to  the  prior  year 
in  all  States  with  a  periodicity  schedule  (for  all  ages)  over  one 
year.  In  States  with  periodicity  schedules  less  than  one  year 
(e.g.,  for  infants)  "previously"  may  refer  to  clients  who  receive 
an  initial  (Is  ,  2n  ,  etc.,  periodic)  screen  during  the  planning  year.* 


*Some  States  have  opted  for  relatively  infrequent  periodic  screens. 
Such  States  will  have  no  periodicity  demand  in  the  early  program 
years  and  the  effects  of  turnover  will  reduce  demand  for  periodic 
screens  significantly. 


In  the  example,  we  will  assume  that  the  number  of  periodic 

eligibles  (#PE)  is  5000  children  and  the  periodicity  rate  is 

one  year.  Adjustment  will  again  be  carried  out  using  the  previous 

year's  average  rates  for  equivalence,  decline,  and  closings. 

APE  =  #PE  (1.0  -  er  -  dr  -  cr  ) 

p     n     p' 

APE  =  5000  (1.0  -  .05  -  .20  -  .10) 
APE  =  4225 

(lb)  PSD  =  APE  x  Periodicity  Rate 
PSD  =  4225  x  1 
PSD  =  4225 

Finally,  by  adding  Initial  Screening  Demand  and  Periodic  Screening 
Demand,  we  arrive  at  Total  Screening  Demand: 

(1)  TSD  =  ISD  +  PSD 
TSD  =  7800  +  4225 
TSD  =  12025 

SCREENING  CAPACITY 

Estimating  provider  capacity  (SC)  for  screening  involves  summing 

the  units  of  screening  which  each  period  can  provide  over  the  year. 

(2)  SC  =  EP,  •  (XU  ) 

1 

where:  P.  =  Each  provider  contracted  to  offer  EPSDT  screening 
XU   =  Mean  screening  service  units  available 


For  example,  Provider  1  =  1,000  units 

2  =   500   " 

3  =  2,500   " 

4  =  2,200   " 
5  =   750   " 

Screening  Capacity  = 6,950  units 


ESTIMATED  SCREENING  PERFORMANCE 

In  the  present  example,  Total  Screening  Demand  (TSD)  is  12,025 
children  and  Screening  Capacity  (SC)  is  6,950  units.  These 
figures  indicate  that  the  State  screening  performance  (ESP)  will 
be  only  6,950  out  of  12,025  children  of  58%  of  those  requiring 
a  screen. 

The  rate  of  Estimated  Screening  Performance  (ESP),  namely  58%, 
indicates  to  the  State  the  need  to  intensify  provider  recruitment 
efforts,  and/or  to  determine  strategies  which  will  reduce  demand. 

DEMAND  FOR  DIAGNOSIS  AND  TREATMENT 

Initial  Demand  for  Diagnosis  and  Treatment  (IDDT)  is  a  conjoint 
function  of  the  Screening  Demand  to  be  met  (SDM)  and  the  Referral 
Rate  (RR)  (positives)  from  screening  adjusted  for  equivalence, 
declines,  and  closings. 


(4a)  IDDT  =  ESP  x  RR  x  (1.0  -  erDJ  -  6rQJ  -  crm) 

where:  RR  =  ^Referrals  from  Screen 
Total  #  Screened 

Screening  Demand  to  be  Met  (SDM)  was  estimated  at  6,950  children 
and  the  Referral  Rate  (RR)  from  screening  is  .75. 

IDDT  =  6950  x,.75  x  (1.0  -  .05  -  .20  -  .10) 

IDDT  =  3388  referrals 

Initial  Demand  for  Diagnosis  and  Treatment  (IDDT)  expresses 
referrals  in  terms  of  number  of  clients  (children).  From  the 
perspective  of  provider  capacity  this  might  be  termed  projected 
patient  load.  In  some  States,  depending  on  the  mix  of  providers 
available  and  data  maintained  on  provider  supply,  such  a  patient 
load  figure  may  be  an  appropriate  estimate  of  demand. 

For  other  States,  units  of  services  (e.g.,  the  average  number  of 
visits  for  Diagnosis  and  Treatment  following  a  positive  screen) 
may  be  a  better  estimate  of  D&T  Demand.* 


*The  algorithm  and  sample  calculation  describe  diaqnosis  and 
treatment  demand  in  a  basic  form.  The  precision  of  the  estimate 
can  be  greatly  increased  if  D&T  demand  is  addressed  in  terms  of 
morbidity  categories  and  types  of  providers  needed  to  address 
such  morbidity.   (For  example,  most  States  will  probably  wish 
to  distinguish  between  demands  for  medical  and  dental  care  vs. 
providers  available.) 

As  with  other  options  the  algorithms  afford,  each  State  must 
weigh  the  cost  and  benefits  of  more  sophisticated  analysis. 


(4a)  IDDT  =  ESP  x  RR  x  (1.0  -  er^  -   drDT  -  crDJ) 

where:  RR  =  #Referrals  from  Screen 
Total  #  Screened 


Screening  Demand  to  be  Met  (SDM)  was  estimated  at  6,950  children 
and  the  Referral  Rate  (RR)  from  screening  is  .75. 

IDDT  =  6950  x  .75  x  (1.0  -  .05  -  .20  -  .10) 

IDDT  =  3388  referrals 

Initial  Demand  for  Diagnosis  and  Treatment  (IDDT)  expresses 
referrals  in  terms  of  number  of  clients  (children).  From  the 
perspective  of  provider  capacity  this  might  be  termed  projected 
patient  load.  In  some  States,  depending  on  the  mix  of  providers 
available  and  data  maintained  on  provider  supply,  such  a  patient 
load  figure  may  be  an  appropriate  estimate  of  demand. 

For  other  States,  units  of  services  (e.g.,  the  average  number  of 
visits  for  Diagnosis  and  Treatment  following  a  positive  screen) 
may  be  a  better  estimate  of  D&T  Demand.* 


*The  algorith  and  sample  calculation  describe  diagnosis  and 
treatment  demand  in  a  basic  form.  The  precision  of  the  estimate 
can  be  greatly  increased  if  D&T  demand  is  addressed  in  terms  of 
morbility  categories  and  types  of  providers  needed  to  address 
such  morbility.   (For  example,  most  States  will  probably  wish 
to  distinguish  between  demands  for  medical  and  dental  care  vs. 
providers  available.) 

As  with  other  options  the  algorithms  afford,  each  State  must 
weigh  the  cost  and  benefits  of  more  sophisticated  analysis. 


(4)  TDDT  =  IDDT  x  XVr 

For  example,  let  us  assume  that  the  average  number  of  visits 
for  D&T  that  a  referral  will  need  is  4. 

TDDT  =  3388  x  4 

TDDT  =  13552  units 

DIAGNOSIS  AND  TREATMENT  CAPACITY  (PTC) 

Diagnosis  and  Treatment  Capacity  (DTC),  as  with  Screening  Capacity, 
is  the  sum  of  the  units  of  D&T  which  each  provider  can  provide 
over  the  year.* 

(5)  DTC  =  P.  •  (XUDT) 

where  P.  =  Each  provider  contracted  to  offer  EPSDT  diagnosis  and 
treatment  services 

XUDT   =  Mean  medical  service  units  available  for  EPSDT  referred 
diagnosis  and  treatment 

For  example,  Provider  1  =   900  units 

2  =  5,100  " 

3  =  3,000  " 

DTC  =  10,000  units 


*Most  States  will  find  it  necessary  to  distinguish  between  demand 
for  different  medical  services  and  availability  of  services. 
However,  our  estimates  treat  all  providers  as  similar,  and  yield 
a  single  measure  of  provider  capacity  which  is  for  demonstration 
purposes. 


ESTIMATED  DIAGNOSIS  AND  TREATMENT  PERFORMANCE 

In  the  present  example,  TDDT  is  estimated  to  be  13,552  and  the 
D&T  capacity  is  10,000.  Consequently,  Estimated  D&T  Performance 
(EDTP)  is  74%  of  demand. 

The  26%  deficiency  in  D&T  capacity  should  indicate  to  the  State 
the  necessity  of  increasing  provider  treatment  capacity  and/or 
determining  strategies  for  reducing  demand. 


APPENDIX  B 

The  South  Carolina  State-Wide  EPSDT 
Planning  and  Evaluation  Data  System 


APPENDIX  B:   SOUTH  CAROLINA 
DEMONSTRATION 


The  South  Carolina  Demonstration  of  a  State-Wide  EPSDT  Planning 
and  Evaluation  Data  System,  supported  by  a  SRS  1115  Grant, 
demonstrates  the  ability  of  a  State  health  data  system  to  support 
EPSDT  planning  and  evaluation  needs  at  both  the  State  and  Federal 
levels.  The  strategy  underlying  this  project  was  one  based 
upon  the  classification  of  existing  data  and  the  development 
and  testing  of  analytical  packages  which  fully  address  planning 
and  evaluation  concerns  at  all  levels  of  EPSDT. 

Consequently,  this  project  has  mounted  a  practical  demonstration 
of  the  validity  of  the  "data  classification"  model.   In  essence 
a  series  of  meaningful  reports  for  planning  and  evaluation 
purposes  have  been  developed  (they  can  be  found  following  this 
Appendix) . 

A  pertinent  step  in  this  demonstration  was  the  definition  of 
planning  and  evaluation  information  requirements  for  a  State-level 
EPSDT  data  system.  This  included  the  identification  of  informa- 


-tion  required  by  the  State  itself  for  program  management  and 
information  required  by  various  Federal  agencies  monitoring 
EPSDT. 

Through  a  data  merging  process,  a  series  of  analysis  packages 
were  then  developed  which  when  statistically  manipulated  could 
produce  meaningful  program  information.  As  limited  modifications 
in  the  State's  on-going  EPSDT  data  system  occurred,  State 
project  administrators  were  continuously  involved  and  consulted 
as  to  the  uses  of  the  system.  An  overriding  objective  throughout 
was  that  project  staff  as  primary  systems  users  would  both 
understand  how  to  most  effectively  utilize  information  generated 
and  would  have  meaningful  input  to  what  information  would  be 
produced. 

Initially,  the  focus  of  State  project  managers  was  targeted  upon 
"compliance"  concerns  which  typically  involved  the  determination 
of  the  extent  of  EPSDT  program  activities.  These  include  such 
areas  as  the  identification  and  notification  of  program  eligibles, 
scheduling,  screening  and  referral  for  diagnosis  and  treatment  of 
eligibles  as  required. 


Issues  of  efficiency/effectiveness  and  proqram  impact,  however, 
were  clearly  not  being  completely  confronted.  Rather  than 
imposinq  an  exhaustive  set  of  new  and  exactinq  data  collection 
requirements  on  the  on-qoinq  EPSDT  system,  a  strateqv  was  adopted 
of  classifvinq  existinq  health  data  already  beinq  collected 
within  the  State.  The  reports  that  this  merqinq  process  could 
then  produce,  it  was  believed,  would  qreatly  aid  State  and  local 
personnel  in  matters  relatinq  to  the  efficiency  and  effectiveness 
of  their  activities  while  simultaneously  allowing  Federal  aqencies 
to  better  comprehend  the  impact  of  these  activities  on  the  eliqible 
pediatric  population. 

Consequently,  the  types  of  information  necessary  for  anv  State 
wishinq  to  operate  a  viable  EPSDT  data  system  for  planninq  and 
evaluation  have  been  evidenced.  In  addition,  the  health  data 
classification  and  analysis  approach  has  been  shown  to  be  hiqhly 
workable  and  desirable  for  EPSDT  proqram  manaqers. 

THE  SOUTH  CAROLINA  EPSDT  PROGRAM 

South  Carolina's  EPSDT  Proqram  is  operated  by  the  Medical  Assistance 


Division  of  the  Department  of  Social  Services.  This  deDartment 
subcontracts  its  EPSDT  screeninq  to  the  State  Department  of  Health 
and  Environmental  Control  (DHEC)  and  specific  Title  V  Proqrams. 
Screeninqs  and  referrals  for  diaqnosis  and  treatment  are  provided 
at  115  local  public  health  clinics  distributed  across  South 
Carolina's  fortv-six  counties. 

Actual  operation  of  EPSDT  is  hiqhlv  centralized  in  the  Medical 
Assistance  Division  (MAD).  Proqram  data  is  computerized  within 
the  Department  of  Social  Services;  EPSDT  en.iovs  its  own  data 
svstem  which  merqes  eliqibilitv.  screeninq  ,and  diaqnosis  and 
treatment  data. 

Each  countv  in  the  State  is  assiqned  a  Quota  of  eliqibles  to  be 
screened  each  fiscal  vear.  A  oeriodicitv  schedule  requires  each 
child  to  be  provided  an  assessment  once  everv  third  vear.  No 
proqram  eliqible  can  be  screened  unless  a  pre-printed  form  (DSS 
1724)  has  been  received  at  the  countv  DSS  office  for  that  person 
from  MAD.  Appointments  for  screeninq  and  return  appointments  for 
diaqnosis  and  treatment  of  identified  conditions  are  arranqed  bv 
countv-level  DSS  personnel.  Each  screen  is  reimbursed  bv  the  State 
at  a  flat  rate  plus  add-ons  for  elective  procedures. 


South  Carolina's  EPSDT  svstem  Drovided  a  basis  for  the  identification 
of  Droqram  eliqibles  reauirinq  notification  of  screening  and  for 
local  DSS  Dersonnel  to  schedule  initial  screens  at  oublic  health 
clinics.  As  modified,  the  data  svstem  now  allows  for  the  identifi- 
cation  of  demand  for  diaqnosis  and  treatment  and  for  the  trackinq 
of  the  individual  client  throuqh  comDletion  of  diagnosis  and 
treatment  and  Deriodic  screeninqs.  This  same  svstem  processes 
both  screeninq  and  diaqnosis  and  treatment  reimbursements  and 
suDDorts  prior  authorization  for  the  ma.ioritv  of  services. 

Information  as  to  the  status  of  the  eliqible  DODulation  with 
resDect  to  screeninq.  diaqnosis  and  treatment  is  routinelv  qenerated. 
Similar  reDorts  are  nroduced  for  each  countv.  Additional  informa- 
tion on  screeninq  findinqs  is  now  available,  thus  Drovidinq  a 
hi  ah  aualitv  data  base  for  client  trackinq.  Routines  are  also 
now  accessinq  data  on  costs  and  client  status  to  allow  for 
meaninqful  determinations  reqardinq  both  efficiency/effectiveness 
and  evaluation  of  Droqram  impact. 

The  six-Dart  DSS  1724  Form  is  comDrised  of  a  client  identification, 
screeninq.  and  diaanosis  and  treatment  sections  which  link  all 


of  the  actors  involved  in  EPSDT  on  a  client-by-client  basis. 

Upon  confirmation  of  eligibility,  a  1724  is  printed  and 

sent  to  the  appropriate  county  DSS  office  where  in  coordination  with 

DHEC  an  appointment  is  provided  for  the  client  to  be  screened.  When 

a  referral  for  a  problem  detected  during  screening  is  made,  the 

1724  accompanies  the  client  to  the  provider  for  diagnosis  and 

treatment. 

The  system  as  presently  structured  now  automatically  produces  new 
DSS  1 724 ' s  for  new  EPSDT  eligibles  not  screened  within  the  last 
three  years,  prints  out  1724's  for  eligibles  needing  a  periodic 
screening  in  the  present  month  and  adds  a  closure  or  removal  code 
where  necessary  on  the  EPSDT  master  file.  A  summary  report  is 
generated  that  tabulates  all  1724's  issued,  incdicating  their 
status,  date  and  form  number. 

In  this  form's  top  portion  is  space  for  a  narrative  statement 
describing  defects  identified  during  screening.  Initially  DSS 
county  personnel  then  coded  this  narrative  statement  according  to 
a  five  letter  code,  A  through  F.  The  F  coding  indicated  "other 
problems,"  those  not  covered  under  the  general  code  categories 


A  through  E  (developed  to  satisfy  Federal  NCSS  120  reporting  require- 
ments). A  number  then  followed  the  letter  F  to  designate  the  total 
number  of  "other  conditions"  but  not  indicating  the  nature  of  each 
of  these  "other  problems." 

This  situation  made  it  practically  impossible  for  DSS  to  determine 
which  of  these  "other  problems"  had  in  fact  been  diagnosed  and 
treated.  As  a  result,  the  development  of  completed  profiles  of 
screening  and  screening  findings  by  suspected  diagnosis  and  the 
detection  of  false  positives  for  "other  problems"  referrals 
were  stymied. 

In  the  course  of  system  modification,  an  improved  and  expanded  two 
digit  coding  system  was  instituted  to  yield  specific  screening 
findings  information.  More  specific  diagnostic  identification 
of  "other  problems"  helped  to  overcome  the  above  mentioned 
limitations  of  the  system. 

Another  highly  critical  modification  involved  the  merging  process 
by  which  screening  and  diagnosis  and  treatment  records  can  be 
accessed  in  such  a  manner  as  to  allow  one  to  tract  a  client 
through  the  full  extent  of  the  EPSDT  program. 


SOUTH  CAROLINA  EPSDT  DATA  SYSTEMS  OUTPUT  REPORTS 

The  South  Carolina  EPSDT  data  systems  as  modified  under  this 
project  now  generates  a  series  of  reports  on  a  monthly, 
quarterly,  or  "as  needed"  basis.  The  format  for  these 
reports  can  be  found  following  this  Appendix.  Following 
the  reports  themselves  is  an  attachment  that  shows  the  flow  of  the 
DSS  1724  among  the  various  components  of  South  Carolina's 
EPSDT  Program.  After  this,  a  third  attachment  provides  a 
series  of  flow  charts  which  detail  the  computer  processes 
necessary  to  generate  the  major  output  reports  now  being 
generated.  Each  chart  refers  to  the  report  or  reports  listed 
at  the  bottom  of  each  of  the  charts.  These  can  then  be 
matched  up  with  the  report  fascimilies  located  in  the  first 
attachment  to  this  Appendix. 

The  following  are  the  output  reports  presently  generated  by 
the  South  Carolina  EPSDT  Data  System: 


Monthly 


1.   Report  of  1724  Forms  Printed  (Report  #3).  Since  this 
DSS  form  serves  as  the  basis  for  the  flow  of  information 


throughout  the  system,  it  is  crucial  to  be  able  to 
determine  when  a  given  client's  form  was  printed  and 
sent  to  the  appropriate  DSS  county  office. 

Report  of  Additional  1724  Forms  Printed  (Report  #4). 
Following  screening,  a  client  may  be  referred  for  diag- 
nosis and  treatment.   If  more  than  one  condition  iden- 
tified during  screening  is  referred,  an  addition  1724 
is  printed.  One  1724  is  consequently  printed  for  each 
defect  uncovered  after  the  initial  condition.  This 
report  details  the  additional  1724's  by  client  and 
county  and  notes  the  condition  for  which  the  client 
is  being  referred. 

EPSDT  Screening  Statement  Report  (Report  #5).  This 
document  assists  in  the  computation  of  the  amount  of 
funds  owed  by  DSS  to  DHEC  for  screening  services 
delivered  to  the  eligible  population.  Service  codes 
are  utilized  to  indicate  which  services  were  rendered 
to  each  individual  client.  This  analysis  allows  for 
the  determination  of  rates  of  screenings,  costs  and 
types  of  referrable  conditions  being  identified  during 


screening.  A  summary  list  provides  the  totals  for 
initial  and  periodic  screens  separately  as  well  as 
totals  for  all  screens.  The  summary  referral  codes 
are  extremely  useful  in  program  impact  evaluation 
and  financial  planning  vis-a-vis  diagnosis  and  treat- 
ment. 

4.  Diagnosis  and  Treatment  Reports  (Report  #6).  This 
report  lists  the  monthly  diagnosis  and  treatment 
transactions  by  client.   Included  here  are  data  as  to 
number  of  visits/diagnosis  and  number  of  visits/treatments 
Cost  items  are  utilized  to  determine  budgetary  needs. 
Summary  reports  on  diagnosis  and  treatment  are  organized 
by  condition  and  include  average  cost  per  visit.  A 

total  is  included  for  all  diagnosis  and  treatment  costs 
for  the  month  by  county. 

5.  Cost  Analysis  Report  (Report  #7).  This  report  allows 
for  the  tracking  of  the  rate  of  program  medical  expenses, 
a  crucial  State  concern.  Separate  sections  for  screening, 
diagnosis  and  treatment  display  costs  by  condition, 
provide  average  costs  per  patient  per  condition  and 


indicate  percent  of  total  program  cost.  This 
analysis  furnishes  the  State  administrators  with 
the  most  critical  financial  information  for  planning 
purposes. 

• 

6.  EPSDT  Status  Report  (Report  #8).  This  is  a  summary  of 
referrals,  diagnoses,  treatments  and  last  treatments. 
The  figures  are  aggregated  on  monthly,  quarter-to-date 
and  year-to-date  bases.  The  last  column  in  this  report 
indicates  how  many  clients  passed  from  screening  through 
treatment  within  a  calendar  year. 

7.  Patient  Status  Report  (Report  #9).  This  report  lists 
each  client  by  county  who  has  passed  through  the  complete 
EPSDT  cycle  from  screening  through  referral  to  diagnosis 
and  treatment.  Of  vital  concern  to  case  managers,  it 
allows  for  the  tracking  of  individual  clients  and  alloca- 
tion of  increased  effort  on  those  clients  most  in  need 

of  follow-up. 

8.  1724  Screening  Forms  Outstanding  -  45  Days  Report  (Report 
#12).  This  lists  the  forms  outstanding  more  than  forty- 
five  days.  The  second  date  listed  under  the  Form  Print 


Date  heading  represents  those  clients  for  whom  the  first 
1724  Form  printed  was  used  for  diagnosis  and  treatment  of 
an  existing  problem  prior  to  screening. 

9.   Diagnosis  and  Treatment  Forms  Outstanding  -  90  Days  Report 

(Report  #13).  This  report  notes  those  Diagnosis  and  Treatment 
Forms  outstanding  more  than  ninety  days.  This  figure  was 
selected  to  account  for  lag  time  in  the  submission  of  bills 
to  Blue  Cross/Blue  Shield. 

10.   Schedule  vs.  Capacity  Report  (Report  #16).  This  is  the 
only  report  presently  in  the  system  that  requires  data 
not  routinely  stored.  Information  is  needed  from  Blue  Cross/ 
Blue  Shield,  South  Carolina's  Annual  Licensure  Program, 
provider  organizations,  etc.  The  purpose  of  this  analysis 
is  one  of  indicating  directions  for  provider  recruitment 
efforts  and  the  capability  of  the  State  to  provide  eligibles 
with  EPSDT  services  within  the  framework  of  compliance  para- 
meters. 

Quarterly 

1.   False  Positive  Analysis  (Report  #10).  This  document 


lists  those  individuals  who  were  referred  as  a  result 
of  screening  but  for  whom  no  positive  finding  was  detect- 
ed during  diagnosis.  A  summary  total  is  also  provided  by 
condition  referred  but  not  confirmed  during  diagnosis. 

2.   False  Negative  Analysis  (Report  #11).   In  this  report 
clients  who  were  referred  from  screening  for  diagnosis 
and  treatment  of  one  condition,  but  for  whom  other 
conditions  not  found  in  screening  were  confirmed  during 
diagnois  are  1 isted. 


'AS  NEEDED" 


1.  Update  Report  (Report  #1).  This  details  updates  by 
client  and  summarizes  transactions  that  have  occurred 

for  a  given  time  period.  This  type  of  information  enhances 
the  maintenance  of  accurate  lists  of  EPSDT  eligibles. 

2.  Closed  Error  List  (Report  #2).  This  report  lists  those 
cases  which  could  not  be  closed  due  to  an  error  in  name 
or  number.  Such  information  can  be  sent  to  county  DSS 
offices  so  that  their  files  can  be  checked  and,  after  the 
error  corrected,  these  cases  can  be  removed  from  the 
eligibility  lists. 
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